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INCENTIVE MAGNITUDE, LEARNING, AND 
PERFORMANCE IN ANIMALS' 


BENJAMIN H. PUBOLS, JR.* 
University of Miams 


Interest in the effects of variations 7. What is the effect of incentive magnitude 
incentive magnitude on learnin acquired reward value? 
nd performance in animals has in his paper will follow an outline 
ised markedly during the last suggested by these questions, and in 
| there are now more than each case an atte mpt will be made to 
ental papers dealing with draw conclusions as definite as the 
pects of this topi These available evidence allows 
been concerned, for the A brief review of some general 


th the following prob methodological considerations would 


seem to be in order to help provide a 
framework for the discussions which 
will follow. A variety of types of ex- 

nental operation have been used 
by different investigators in the 

ipulation of incentive magnitude 
These operations have tended to fall 
into one of five classes, usually in 
volving the manipulation of food in 
some form, but sometimes water, or 


a receptive female of the same spe- 


These classes of operations are 
variation in weight, volume, or 


a single incentive unit; (0 
variation in number of equal-weight 


, incentive units; (c) variation in dura- 

reward, and reir , 

terchangeably in this tion of exposure to the incentive; (d) 
‘ 


ii which strengther Variation in concentration ol sugar, 
low, without implication of usually suc rose, solutions and (e) 


Oo any part t theoretical variation in incentives whic h do not 
Such phrases as “variation in in 
ignitude,”’ quantitative varia- 
the like, are also used interchange- 

n General Test Apparatus is tent of incomplete sexual behavior. 
ated WGTA; periodic reinforcement is It should be apparent that the 


ited PI 


alter the effects of de privation, suc h 
is concentration of saccharine, or ex- 


” ictual dimensions, or mechanisms, 


auth would like to express, his ap 
A. M. Schrier for his critical 


minary version of this paper, and that they may differ among 


89 


of quantitative variation are several, 
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these classes of operations. Guttman 
(1953) has pointed out that the ex- 
reiniorcing 


pression, “quantity of 


refer to several dimen- 


ition. He 


agent,’ may 


sions of vari lists these as 


follows 1) amount of nutrient ma- 


terial available for assimilation, in 


terms of weight or volume; (6) stimu- 


lation (pri visual, but may also 
I derived from 


e olfactory or tactile 


incentive itory 


beh iv fT 


itory 


prior to consumm 
amount and nature ol 
activity involved 


7) stimulation from the incen- 


ti during consummation (e.g., taste 
characteristics 

Kling (1956) has further i: 
that the th 


activity, may be 


dicated 
rd factor, consummatory 


broken 


several subdimensions, which 


down into 


er of con 

duration of con 
r 10 of consummatory 
summatory respon 
irea, and rate o 
sponding 

Different combi 
tion result from different operations 


hus, the 


itions 


two classical operations, 


ind 


weight 


I volve Ss ( 

iterial 
ty. The manipulation 
volves 


ount of 
itory 


ncentration in con- 

variation in i! 
rial and cor 
And the fifth operation 


Vari 


ition 

lead to concurrent 

nt of 

ind stimulaticn during that activity 
The consideration of differences in ex- 


consummiatory 


perimental manipulations will be 
central 


nisms of reinforcement 


to the discussion of mecha 

A second category of methodologi- 
cal differences is related to another 
question raised above. This concerns 
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the number of incentive magnitudes 
1957) 


each S ex- 


a given S experiences. Lawson 
calls the method whereby 
periences only one value the ‘‘abso 
method, and the method 
each S 


value 


lute”’ 
whereby experien 


than one the 


i, 
iiies 


For the most part, st 


method. 
utilizing the differential method will 
be considered in a separate section 

lo answer the question of whether 


variations in imcentive magnitude 


affect learning or performance, a 


special two-phase experi ental de 
sign will be required 
the 


another 


rhis will be 


outlined in appropriate section 


device f{ dis 


il d 


However, 


} 


tinguish’ng between learni 


peritormamn efliects, which 
this paper, req 


This is the 


erre 
-asures ol 
iwh there are 
grounds for 1 
ent, the 


which 


revicw 
follows sl 
worth 
It will be noted th 
ng omitted whic 
to the issue 
For exat 
) ' are I 
that the 


writer feels 
them to be unimportant or unsuccess- 


is not to say 
ful. Rather, the aim of the present 


paper is to attempt to order the em 


pirical evidence regarding ince 
theorist will 
the data 
That 1s, 
an empirical, 


itive 
magi tude, so that the 


have a clearer picture ol 


with which he will work 


the paper will attempt 


rather than a theoreti li 
Theoretical discussions will be found 


tegration 


in most of the papers to be reviewed, 


especially the following Crespi 
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(1944 
1952, pp 
Pereboom 
ind yx nee 

Also 
studies of the 
Blodgett, 1929: 
1930 Dhev 
to the present paper, as it is possible 
to il them 


ing a change in incentive magnitude, 


Hull (1943, pp. 124-134; 
140-148); Meyer (1951); 
1957b); Reynolds (1949); 
1956, pp 27-148). 
omitted are latent learning 
Blodgett type (e.g., 
Tolman & Honzig, 
ire especially pertinent 


terpret as studies involv- 


minimal amount to a larger 


peciiiable amount. When so inter- 
preted, their results agree quite well 


with the results of studies to be re- 


However, the latent learn 


irom a 


ewed 


‘ experiments have been ade- 


reviewed elsewhere a number 
Ihistlethwaite, 1951 


; lies it) 


idministered 


which reinforce 
other than 
¢.“., intravenously or 
excluded In 


be re- 


fistula) are 


words, this review will 
1 to studies in which incentives 
" 


ed peripherally, and 


exteroceptors 


LEARNING AND ASYMP- 
TIC PERFORMANCI 


he evidence to be 


reoorted in this 
be based on situations in 
are given a series ol 

re trials under one ol 

ft reinitorcement, 

are made of ter 
nance level and rate of 


to this level. Unfortunately, 


proat nN 
there is not sufficient evidence in all 
that these termin 
represent asymptotic per 
ce Nevertheless, some meas 
‘rformance over the final few 
training trials is usually given 


Many have 


differences in rate of approach to as- 


investigators taken 


ymptotic pertormance level as a func- 


tion of incentive m 


urnitude to reflect 
in effect on rate of learning, and dif- 


ferent asymptotes to reflect a differ 


ence in performance While the 
former interpretation may be legiti- 
mate, the latter definitely is not. A 
higher terminal level could be an 
indication of a greater amount 
learned, or that amount of learning is 
the same but performance is superior. 

Relevant manipulations have in- 
cluded 
amount by all five of the 
outlined in the introduction. 


variations in incentive 
operations 
7 hese 
will be considered in turn, and, unless 
the 


method of incentive presentation was 


otherwise stated, absolute 


used. 


Variation und Number of 
Incentive 
Apparet the first study of 
quantitative variation was Grind- 
ley's, reported in 1929. He trained 
hve groups of chicks to run down a 
way to either 0, 1, 2 4, or 6 grains 
When reciprocal run- 


ning times on the last five of seven 


ot boiled rice 


trials were plotted against the num- 


grains oO! rice, an 


negatively acceler 


ber of increasing, 
ited curve was ob- 
just what this 
That it 
performance 


tained. It is uncertain 
curve represents, however 
represents asymptotic 
with so few trials is questionable. 

Wolfe (1941) 


used chicks as Ss. Three groups were 
three 


and Kaplon also 


run successively on each of 
| rol lems, iru detour problem, 


ind T maze. | 


out the 25 or 


way, 


Lunning times through- 


35 trials given on each 
problem fell in the following order, 


to longest, for the three in- 


, 
shortest 


centive amounts used: four quarter- 
grains ol popcorn, one full grain, and 
one quarter-grain. Critical ratios on 
the final training days (consisting of 
five trials) indicated no significant 
differences between groups, but sev- 
eral approaching significance in com- 
parisons involving the one quarter- 
grain group. Inspection of the Wolfe 


and Kaplon curves indicates a similar 
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rate of approach to the asymptotes 

among all groups on all problems 
Crespi (1942 runway train- 

ing to various groups of rats, with 


gave 
the number of incentive units given 
as reward varied in logarithmic steps 
Each incentive unit weighed .02-gm. 
and the numbers of units used were 
1, 4, 16, 64, 256. Asymptotic 
running speeds (Trials 21-25 in one 


and 


experiment, Trials 16-20 in another 
were an approximately logarithmi 
function of the number of incentive 
units. On the other hand, rate of ap- 
proac h to these asymptotes was ap- 
proximately constant for the various 
incentive values These findings, 
that the amount of incentive affects 
performance at but 


rate of approach to the asymptote, 


asymptote not 
have with few exceptions been con- 
firmed in later studies using the ab- 
solute method of incentive presenta- 
tion. 
Continuing with 
Zeaman (1949 
weight of single incentive units as 
follows: .05-, .20-, .40-. .80-, 1.60- 
and 2.40-gm 19 daily 
trials were given, and equations were 


fitted describing the decrease in 


the runway 


studies, varied the 


I ighteen or 


latency over successive trials, treat- 
ing Trials 14-19 as 


Equation constants representing as- 


asymptoti 


ymptotic performance differed sig- 


nificantly 


from each other, while 


those representing rate ol ipproac } , 


or the slope constants, were nearly 
Conclusions are again 


iffects 
but 


identical 
cle () it ; ion 
lear wuantitative variation 


terminal level of performance 
not rate of approach to this level. A 
plot of asymptotic log latency as a 
function of log grams of food yields a 
decreasing function with slight posi 
tive acceleration over the range in- 
vestig ited , 

Additional runway studies have 


corroborated these findings. Among 


these are the studies of Lawrence and 
Miller (1947), Metzger, Cotton, and 
Lewis (1957), and Spence (1956, pp 
130-132) 

Iwo other runway studies require 
brief comment. Pereboom and Craw- 
ford (1958) both 
running time and competing response 
time over 40 trials, and found that 


measured forward 


incentive mag”.ctude affects both var- 
iables, the latter more so These re- 
sults s lggest that a good deal of the 
‘learning’ that is shown by a de 
crease in running time (or 

related time measures 


reflect the elimination of 
response tendencies, such 
the 


marked decrease in foru 


tion, and like, rath 
time 
Gagné 1941 found in 


ate ol ind 


terminal log latency for 


icquisition 


ing trials, as a function 


amount However, for 


incentive 


confoundec 
interval such th 


this study, 
completely 
trial 
rest if! were iss 


The { 


amounts 


tervals 
larger amounts 
rate for larger 
the disiribut 


eftiect, and not to the 


due to 


centive received 
A study by Hutt 
bar-pressing re 


finding 


periormance is 


itilizing 
confirms 
mptoti 


ted to 


unway 


incentive magnitt varied 
both quantity a1 ! 
ind 
fects on rate of responding under PR 


3-, 12 


50-mgm., manipulated by \v 


Tih\ 


tive factorially their ef- 


issessed 


rhe three quantities were , and 


irying 


the size of the food dipper, and the 


basic diet plus 


three qualities were a 


( preferred basi 


diet plus 


] he il 


saccharine most 


diet alone, and basi citri 


acid (least preferred mals 
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had first received training under con- 
tinuous reward, and cumulative re- 
sponse curves under PR are essen- 
tially 
cluded that the obtained significant 


linear Thus it can be con- 
effects of both quantity and quality 
differences in 


rhe 


direction in 


represent asymptoti 


differences were 


both 


pertormance 


‘ x pecte d 

udies have employed 
visu il 
} 


Suc h as 
ind T maze 
1949) trained 
i black-white dis 


incentive 


tasks, 
). 


pro 


two 


i single 

her 30 or 160 mgm 
iat, although mean re 
sponse 
fered i rh intly, 


nes for the two groups dif 
differences in 
were negligible, the 
vithin one trial of each 

vestigators (Hopkins, 

1956a) have obtained 
n learning results in sub- 
Reynolds 
Reynolds 
d acquisition of a 
ibit over 
with the 
30 or 


ment with 


study, 


1 constant 
incentive 
ther 160 mgm 
er percentage ol cor 


and 


larger amount 


faster running 
group 
indicates 
but dif- 


o1 , , 
| levels of perlormance 


his curves 
yf ipproar h 
nployed a multiple 
hoice linear maze ind 
imount of incentive 


to have a differential 


learning measure 
measure 
Hever 

maze 


periormance 
Finally 


time 
five-unit 


runniny 
1951 employed a 
and groups of rats under either high 
or low thirst The high drive 
Ss drank significantly more water in 
the goal box than did the low drive 


drive 


animals and thus received larger re- 
ward. However, the two groups 
failed to differ in terms of trials or 
errors to criterion, or times per trial 


Variation in Duration of Incentive Ex- 
posure 

Kling (1956) employed a runway, 
the thirst drive, and water as incen- 
Amount of water incentive was 
with 


tive 


manipulated factorially two 
levels each of duration of exposure to 
the drinking tube (15- and 120-eec.) 

d drinking and 


Several consummatory re- 


sponse measures were obt iined and 


tube diameter (2 


in 
5 mm.). 


running speeds over the last three of 
13 daily trials were found to be un- 
systematically related to the volume 
of water consumed trial, time 
per trial actually spent drinking, and 
goal box spent 


[hey were positively re- 


per 
proportion ol! time 
drinking 
lated, however, to ingestion rate, a 
measure of consummatory activity 
In a similarly designed study, Hellyer 
(1953) independently varied amount 
of water reinforcement and drinking 
tube size, and found that both vari 
affected 


an inverse correlation be- 


ables runway latencies 
There was 
tween duration of consummatory re- 
sponse and latency 

Fehrer (1956) carried out 
periments, one with a U maze, the 
other with a runway, using the thirst 
both time in the 


incentive 


two ex- 


drive and varving 


goal box and amount of 
Rurining speeds were found to vary 
systematically with neither amount 
of incentive (40-sec. drinking vs. 10- 
sec. drinking followed by an addi- 
tional 30 sec. in the now empty goal 
box) nor time in the goal box (10-sec. 
drinking vs. 10-sec. drinking fol- 
lowed by 30-sec. delay in the goal 
box). 

Spence (1956) has pointed out that 


in the majority of the studies of the 
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type in which weight or number of 


incentive units are manipulated, du- 
ration of time spent in the goal box 
been confounded with magni- 
tude, Ss typically 
the 


the incentive 


has 
being allowed to 


remain in goal box until, and 


been 
just 
to this) 


only until, has 


consumed (the Fehrer study, 


describe l, iS an exception 


Iwo of his students, Swisher and 
Czeh, varied and 


tion independently by allowing 


magnitude dura- 
rats 
re in the goal 
box equivalent to that of 
with sn amounts, but 


with larger amounts tir 


animals 


then al 


eating 


l iller 


lowing them to finish else- 


These two studies, one meas- 
the 


where 


uring bar-pressing latencies, 


other, runway speeds (re- 


pp. 


evidence 


starting 
141) 
that 
varies as a function of duration in the 
ind not 
Thus, they 
ind Fehrer in the finding that 
does not vary with the 
but dis- 
agree with Fehrer’s finding that per- 


with 


ported on 138 both pro- 


duced performance 
amount con- 


with 


goal box 
sumed. agree 
Kling 
periormance 
actual amount consumed, 


for nee did n vary dura- 


and 


Studies in which variation in 


centive | gnitud is achieved by 
manipulating * concent: 
e solutions pr 


sugar or saci 


some ppare 


[ nt exceptions to t.t¢ 


that 


nt of quantity ol reiniorcing 


eralizations rate of learnin 


independ 
agent, and 


asymptotic periormance 


is a Monotonic function of quantity. 
[he first investigator to vary con- 
solutions 


centration ol was 


1953 


Sugar 
Guttman Different groups 
of rats were presented 4%,, 8%, 16%, 
or 329, sucrose solutions as reifi- 
forcem:.)t for bar pressing, and the 


effect was measured on response rate 


during conditioning, extinction, and 
PR, and on time for original condi- 


tioning. The measures obtained dur- 


ing original conditioning are of im 


Asymy 


sponse rate, and rate of approach to 


nediate concern. totic re 


this asymptote were found to vary 


with concentration The relation 


between rate of ! 
centration wW 

creasing, but 
ncreased u 
off at 32% 
that time 


the requi 


responses during acquisitio 


decreasing function of c 


tion [The two measures ol 

tion rate yield results see: 

with findings previou 
reviewed. The 32% group clear! 
tained its termin 
fewer 


consistent 


il response r 
reinforcements than d 
But 
for the 32% group is lower thar 
for either the 8° 
Guttman 


other groups the asy! 

o or the 16% groups 
that th 

asymptote might be d 

trolled drinking behavior in c 


suggests wer 


ue to 


tion with bar pressing 
reconcile the finding of { 


tion rate with increased 


incentive in this study 
sults which failed to find 
tionship, one possibility 
the status of an artifact 
monotonic asymptote ts 
in artifact, and this 
function and the differe 
rates are probably inter 


the 3. ‘ group has les d 


to reach asymptote, it wi 
sooner. 

In two studies, Young 
(1954 


sucrose 


1955) investigated 
concentration on a 

In the first stud 
latency and running time 


response 
were 

ured where concentrations were ; 
6%, 18%, and 54%. By the end of 
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18 daily trials the groups had ordered 
themselves in terms of latencies in 
the order indicated, greatest to least. 
But asymptotic running speeds were 
the same for all groups. Finally, these 
asymptotic speeds were achieved 
sooner the higher the concentration, 
a finding paralleling Guttman’s. This 
finding is possibly artifactual also, 
because, on the initial trials, Ss with 
higher concentrations were running 
(all Ss had had preliminary 


training with the appropriate con- 


faster 


centration, and this can account for 
the initial gradient), and hence pre- 
they had less far to go to 
In the 
concentration 


sumably 
reach the common asymptote 
(1955) 


second study 


was again varied in logarithmic steps 
to 54°. 
lerminal running ! 
eriminal TrUNnnINg specas 


lated to 


from 2% ind 25 daily trials 
were wivel 
onotonk ally re 


both the 


volume of sac- 


1957) varied 
and 
olution, and 


issessed their 


VY, running time, and 
correct responses in a 
Trials 2—40, the 
rrect responses i! 
with both 
latency and 
significantly 


per 
wre ased 
variables 
reciprocal 
reased 

concentration 


nt > 
Nniakt 


correct 


measure, there was a sig 


interaction between volume 


ncentration, such that for the 
ller of two volumes the effect of 
enotonic, but 
the effect of 
concentration monotonic 
Finally, Smith Duffy (1957) 
reported faster learning of a T-maze 
habit when the reward was 4 cc. 20% 
sucrose than when only .1 cc., in 


‘ ftratio was 
for the larger volume 
was non 


and 


terms of increases in percentage cor- 
rect, and decreases in running time. 


Here we have another possible ex- 
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ception to the generalization that in- 
affect 
their 
were 


centive magnitude does not 
rate of learning. However, 
measures of rate of 
somewhat unorthodox and no direct 
statistical comparisons in terms of 
In the interests 


learning 


volume were made. 
of parsimony, and until this design is 
repeated, preference is to maintain 
the original conclusion that learning 
rate is independent of incentive mag- 
nitude. 


Zero Incentive Magnitude 


A final set of three papers are re- 
lated in that, in each, one of the mag- 
nitudes employed was a zero mag- 
nitude. Furchtgott and Rubin (1953) 
used a two-unit, linear T maze and 
assigned different groups of rats to a 
single incentive unit weighing either 
0, 20, 75, 250, or 2500 mgm. No dif- 

three measures 
trial to criterion, 


ferences in terms ol 
of rate of learning 
number of Ss attaining this criterion, 
number of errors during the precri- 


terial period) were found except that 
| I 


ll groups 
amount did better than the group re- 
However, mean 
the 


two 


receiving any positive 
ceiving zero amount. 
rut ng speeds did differentiate 
the 
larger reward groups running faster 
than the two smaller reward groups. 

Iwo other studies support the find- 
ing that a positive amount leads to 
than amount. 


and (1958) 


positive amount groups, 


Zero 
Elkind 


interaction 


learning 
Seward, Shea, 
found a significant be- 
tween incentive amount (a l-gm. or 
no pellet) and 
trials, indicating a possible effect on 


faster 


a .5-gm. pellet vs. 


rate of learning, but there was no 
mprovement at ali when the goal 
box was empty. Smith and Kinney 
(1956) found faster bar pressing for a 
reward of 20% sucrose solution than 
for 0% (plain water), during a single 


26-min. session. 
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LEARNING VERSUS PERFORMANCE 
EFFECTS 

[he tentative conclusions arrived 
at in the preceding section are that 
incentive magnitude does not affect 
rate of learning but that it does af- 
fect The 
present concerned 
with whether 
ymptotic performance reflects a dif- 


asymptotic perlormance 


section will be 
this difference in as- 
ference in amount learned, or in level 
of performance independent of learn- 
ing. The experimental differentiation 
of le ! 


irning and performance effects 
requires a 


two-phase experimental 
a training and a 
per- 
preferably should be as- 


design, comprising 
test 


formance 


phase Training-phase 
ymptotic before the test phase is in- 
troduced. Measures obtained during 
the training phase would not, as we 
have noted, differentiate learning 
effects, as 
and, if so, 


either 
their 


and peritormance 
could be present, 
measurements would be confounded 
However, where incentive magnitude 
is varied during the training phase 
but held otherwise 


equ ited 


constant (or 
the test phase, dif- 
during the 


differences 


during 


ferences Ii! 


pertormance 
test phase would reflect 
In contrast, 


held 


ph ise 


: , 
in strength of learning. 


where incentive magnitude is 


constant during the training 


but varied during the test phase, test- 


phase perior ince would reflect ef 
tects of conte 


porary incentive mag- 
nitude and hence a direct effect on 
pertormance These interpretations 
rest on the assumption that learning 


should be 


etiects 


relatively perma- 


ent and carry over from one phase 
to the next, while performance effects 
should not (Lewis & Cotton, 1957 
Maher & Wickens, 1954) 

An implication of these statements 
is that, if magnitude affects learning, 
the approach to the new asymptote 
under test-phase magnitude (where 


there has been a change in magnitude 


in going from one phase to the next) 
should be gradual, as it was in the 
training phase. But if magnitude af- 
fects momentary the 
approach to the asymptote 
might be either gradual or abrupt 
The most compelling evidence that 


pertormance, 


new 


magnitude affects performance inde- 


pendently of learning would come 
from findings of an abrupt chaz 

This is no 

essary requirement however 

that 


tendencies might prevent su 


periormance level 


? ; 


possible COMM ps iny 


formance shifts see Pereboom 
1957a, 1957b I 


tive 


n contrast, if incen 
amount 


not 


magnitude iffects 


learned, and learning is con 
strued as a one-trial affair, then the 
effects of change in magnitude must 
include a gradual change in level of 
periormance 

Variation in Weight and Number of 


Incentive Units 


The earliest study to use 
and test ph uses, as here defined 


1942). In one of 


ifter rats trained 


training 
was 
Crespi's 
mencs, 

four incet 
ble asvri 
both 


another 


one or 
reat hed st 
nitudes were 
units In 


and 


dow! 


exper 


256-unit groups were 
to 16 units. In al 


16 condition runt 


were abrupt such that 


to the ne 
the running speed of t 
reached the level of Ss 


ntive 


he 


exposure 
amount, 
animals 
trained with 16 units from the start 
In the 


reached after two exposures 


1-to-16 case this vel was 
Addi- 
tional training at these new values 


led the 


their performance levels 


“ove rshoot”™’ in 
Phat is, Ss 


an increase in incentive magni- 


animals to 


with 
tude ran faster, while those with a 
decrease ran more slowly, than those 
trained with 16 units from the start 
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Both ol 
were significantly different from ob- 


these overshooting effects 


tained or extrapolated values for the 
16-unit rats, and were labeled “‘ela- 
effects, re- 


tion”’ and “depression” 


spectively. Later investigators have 
dubbed 
and “negative contrast” 
ott (1928 


contrast” 
Elli- 
had earlier found an effect 
similar to the negative contrast effect 

a muitiple T 


woen 
incentive 


them ‘‘positive 


eflects 


rats trained in 


with bran mash as 
shifted to 


Crespi’s results indicate that the ef- 


maze 
were sunflower seed 
fect of change in incentive magnitude 
is one of sudden change in perform- 
ince, and thus suggest that incentive 
magnitude affects level of perform- 
ince rather than amount learned 
Zeaman (1949) also studied the ef 
fect of sudden shifts in incentive mag- 
nitude upon runway behavior. 
Changes in latency were abrupt, o 
curring after but one exposure to the 
incentive values 
nent, the 


rectly proportional to the change in 


new In one experi 


change in latency was di- 
amount, and in another, based upon 
a positive contrast ef- 
obtained, 


extra] ol ition, 
fect 


negative contrast effect was not sig- 


was but a possible 
nihcant 

Another study 
mation based on abruptness of per- 


rom which infor- 


formance change can be 
that of Spenc 1956, pp 
Following runway 


either .05 m 


obtained is 
130-132 
trials with 
incentive, these 
Again, 
were 


values were interchanged 


changes in strength 


nt . 
istantanecous A 


response 
significant nega- 
ve contrast effect was obtained, but 
not a positive contrast eflect 

Me tzver, ( otton, and Lewis ( 1957 
mployed a factorial design in which 
four groups of rats received either 
two or eight 45-mgm 
first and runway 

Speed of running during the 


second (test-) phase varied only as a 


pellets during 
the second 10 


trials 
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function of incentive magnitude dur- 
ing that phase. 
effects, this study has the obvious ad- 
the others that 
parisons need not be made on the 


In assessing contrast 


vantage over com- 
basis of extrapolation to what per- 
formance might have been had incen- 
tive shifts not occurred, for, accord- 
ing to the design, only half of the Ss 
experienced a change in incentive 
amount. Although changes in run- 
ning time occurred within one or two 
trials following incentive shift, there 
was no evidence for either positive 
or negative contrast effects 

It is clear from these studies that 
incentive 
rather 


quantitative variation in 
affects level of performance 
than But 

the contrast effects to be interpre ted? 
Crespi and Zeaman gave their Ss 18 
20 training trials before shifting in- 


amount learned how are 


centive 
48 preshift trials 
Zeaman found positive contrast ef 
fects but Spence did not 

argues that found by 
ind Zeaman were artifacts, due to 
the possibility that their had 
not had enough trials to reach a true 
the 
His evidence, reported 


values: Spence gave his Ss 


Both Crespi and 


Spence 
those Crespi 


rats 


asymptote before shifts were 
introduced 
ibove, supports this interpretation. 
In other words, perhaps performance 
have 


without 


would continued to improve 
in in- 
that 


preshift 


inyway, the increase 


centive magnitude However, 
Metzger et al. gave only 10 
trials, fewer than any of the other ex- 
and failed to 


perimenters, demon- 


strate positive contrast effects, ar- 
Out 
excluding the Elliott 
two demonstrated each 


gues against Spence's position. 
of four studies 
only 

effect, 


maintained 


study 
the study 


control Ss 


type ol and one 
which 
shifted 


both types ol « tlect 


not 
results for 
Before the mat- 
information is 


vielded negative 


ter is resolved 
needed on the conditions under which 


more 
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contrast effects would and would not 
expec ted to appear. 
has suggested that runway 


be Pereboom 


1957b 
familiarity and competing explora 
tory behavior are important variables 
Iwo related pos 
sibilities First 
it should be noted that both Crespi 
ind Metzger et al 
ures based on running time and that 


this connection 


surwest the mselves 


in 


employed meas 


iway used by ( respi, who ob 


hve 
by 


itive 


positive results, was 
is long as the one used 


, who obtained neg 
\ y 


portant variabie Second 


v? 


length may be an im- 
regarding 
the extent of preshift training, if an 

to 


+ - | 
ire given suifcient triais 


bring them to the true * 


mals 
‘ohvsiological 
} } ; , 

} be difficuit il not 


} Se ¢ 


ior iow-to-nhi 


it woul 
| » exceed 


wh 
animals tlready on 
iwunt 

involv 

1 used 

nplex 


W LAC 


were 


} ! 
tiple 


i constan 


ter reward. During this 


imount ol water re\ 
relearning test, neither time nor errors, 
as a function of training-phase 


nae 


nitude, were significantly different 


Variation in Concentration of Sugar 
Solution 
Following conditioning, extinction, 


and reconditioning, Guttman’s (1953) 


H. PUBOLS, 


JR 


rats were tested under 1-min 


PR for 
five daily $-hr. sessions. Rate 


ot re 


sponding was an increasil loga 


rithmic function of concs 


Note that 


phase involved, not 


in his study, 
a shift 
a shilt from con 


PR, 


tive magnitude, but 


tinuous reinforcement to ind 


that the relation between itude 


and performance changed from non 
to 
ind Shutord 


itions ol 


monotonK monotonic 
Young 
+} 


ne concentr 


the 


1954 
their 


18 conditior 


Che ge 


' 
hMOwlny 


ported ibove 


i decrease in total ti 


runnin time) when 

is increased and 
when con 
he fort 
ronounced tha 

ind this diflerence 

practice etiect 
Dufort 
20 tr 
1 10% 
bottle « 
Followin 


ied 


and Kis 
ning tf 
SUvar 
ips lox 
iorm 

ind contin 


split 
extinction), 5° 
centration tor 


he 
the 


Following t 


centration 


groups 
nd il 
nptot peri 


n achieved bef 


the 
nh percet 


ferences in reciprox 


! 


were aiso assessed 


change in perfor 
group was abrupt while 


changes were gradual. Ter: il run 


ning, spec ds were a 


of concentr ition, 


positive tunction 


and the rate of ap- 
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proac h to these speeds was the same 
in all « group, 
whose greater 
than that of the other groups. rhis 
difference may be due to the fact that 

had not 
been achieved before differential con- 
Dufort 
the in- 


ises except for the 20% 


slope constant was 


isymptot periormance 


centrations were introduced. 
and Kimble conclude, oe 
ion is that the effect of changing 
junt of reimlorcement is at 
vartly on performance rather 
p. 190). We would con- 

the effect is exclusively 

They also suggest, 

of the near identity of 
slop that extinc- 
ilized as the limitin 


the amount of in- 


TO EXTINCTION 


efiect of incentive 


stance to extinction 


grouped in terms 
ire em] loyed 
h ive used as 
extinction 


ve issessed 


nce over a constant number 


(Jne report how- 


ough inlorma 
ition This was 
1940 


, 
who com 


lance ol 


resistance (oO 
iter following the 
ounts 
icrion 
| 
l employed a 
ified 


unsystemat 


spec 


| eX- 


i 
tive magnitude, 
systematic etfiect. 
Miller (1947) 


difference in 


etiects ol prior ince 
while one found a 


Thus, | 


found an 


iwrence and 


insignihcant 


trials to running response extinction 
criteria of either 3- or 5-min. latency 
as a function of prior amount (one or 
Reynolds (1950b) ad- 
ministered rewards to three groups 


four pellets 


of rats for 25 consecutive bar-pressing 
responses [he three groups rec ceived 
one 60-mgm. pellet, two such pellets, 
or one 160-mgm. pellet for each re- 
No significant differences 
between the 


groups in terms of responses to a no- 


sponse 
were obtained any ol 
criterion of 5 min. In a re- 
Reynolds, Marx, and 


obtained no 


response 
lated 
Henderson 
differences in trials to 


study, 
(1952) sig- 
nihcant ex- 
tinction of a bar-pressing response 
following 120 vs 

ind Shuford 


Young 


guished their Ss with distilled water 


30 mgm. reward 
1955) extin 


) 


following the 25 training trials previ- 


ously mentioned. The slope of the ex- 


tinction curves of running speeds 
varied directly with prior concentra- 
tion Nevertheless, Ss with 


reat hed 


sooner than 


lower 
in extinction 
with 


concentrations 
criterion those 


higher concentrations, perhaps be- 
cause they had less far to go to reach 


this criterion. 


, ‘i 
Performance over a Constant Number 


I riinciion T? 
Zean 
his various experiments to extinction 
| they 


Js ol 


in (1949) subjected the 


response aiter 


ot the running | 


had completed their rewarded train- 
without test- 


ing between training 


either with of 
phases interve 
and extinction In all three of his 


experiments, the effect of previous 


magnitude was to alter the rate of ap- 
1 final common perform 


(1941 


inal extinction level (after 


proac h to 


ance level. Gagné reported a 
higher tert 
for greater 
confounded with 
Metzger 


their Ss 


only five extinction trials) 
reward amounts, 
intertrial intervals. 


(1957 


longer 
et al 
after the training and test phases con- 
Using running times 


extinguished 


sidered earlier. 
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during Extinction Trials 2-11, or Ex- 
tinction Trial 2 alone, training-phase 
magnitude had no effect. However, 
test-phase magnitude had a signifi- 
cant effect on both measures, greater 
resistance following the larger 
amount 

Following PR under three levels 
each of quantity and quality, Hutt's 
(1954) rats were given two }4-hr. ex- 
tinction Responses during 


SESSIONS 


extinction varied as a function of 
both variables, more responses being 
PR 
preferred 
Guttman found 


sponding during an initial 5-min. of 


emitted following with larger 


amounts and qualities 
(1953 rate of re- 


to be an increasing mono- 


the 


extinction 


tonic tunction ot concentration 
of sucrose used during conditioning 
(1956 


extinction (in 


Fehrer found greater re- 


sistance to terms of 
both running speeds over a constant 
and trials to various 

following the 
drinking followed by 30-sex 
postreinforcement delay in the goal 
box, than following either 10-sec. or 
40-sec. drinking time in the goal box 

According 
effects are 
manent while performance effects are 


number of trials, 
criteria) condition of 


10-sec 


to the assumption that 


learning relatively per- 


momentary, we would be led to con- 
clude, on the basis of extinction per- 
formance differences found for a con- 
stant trials, that 
tude of iffect learning 


number of magni- 
reward does 
when the absolute method is used. 
However, it might be that the higher 
performance level during extinction 
following larger amounts is due to 
the fact that 
level is higher the greater the amount 
In fact this appears to 
be the case. Metzger et al. (1957) re- 


ported results of an analysis of co- 


terminal acquisition 


of incentive 
variance upon their extinction scores, 


where performance levels at the be- 
ginning of extinction were equated 


H. PUBOLS, JR 


in terms of running times during the 
Under 


effect of 


trials 
the 


last five reinforced 


these circumstances, 
test-phase amount on extinction dis- 
appe ired They conclude, “.. . re- 
ward affects performance on extinc- 
through tial 


periormance just prior to extinction 


tion differer levels ol 
rather than affe« ting periormance on 
1&8 If we 


the 


extinction directly’ (p 


apply this interpretation § to 


other studies in which perfor: 
was measured over a const 
ber of extinction trials, the cor 
that ine 
t amount ol teart rt 


d This 


account for the 


entive 


magnitude 


interpret 
t 

11soO 
results of Yor 


1! kehrer 


trials to extinction criterior 


momoous 


Shuford (1955) ar 


INTERACTION OF INCENTIVI 
MAGNITUDE WITH OTHER 


VARIABLES 


Several investigators have m 


incentive magnitude 
7 
i 


ulated 


ally with other vari 


es 
their results agree with previ 
they ! 


clusions, ilso provide 
tion on possible interactior 


variable with other vari 


particular, studies have 


assessment of interact 
with 


level if 


tive magnitude 
ward, drive 


forcement 
Uu tlity of Reward 

Hutt (1954) four 
of quantity and quality of reward on 
rate of bar pressing during both PR 
! 


were indepetr of 


1 that the effects 


ind extinction 


each other, the interaction 


the former case being less th 


Drive Level 


Seward, Shea, Elkind 
factorially varied incentive 


1958) 


magni- 


ind 
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tude and length of food deprivation, 
and assessed their effect on running 
tjoth main effects were sig- 
nificant, as the 
But this interaction is 


5} vced 


was interaction be- 
tween them 
based on compa) 1s0ns involving zero 
reward amount and zero hours dep- 
No took 


tiation or when the goal box 
the 


' 
rivation earning place 


was empty That teraction 
might represent a special case found 
only when values of either incentive 


rnitucde 


mag or length of deprivation 


Seward et 
i recent study by 
1958 They 
1.0, 


time 


ire suggested by 


zero, as 
1s ittested by 
olds Pavlik 
iwnitude a 


deprivation 


neyi and 
v iried incentive 

ind 2.0 gn ind 
? 


3, 22, and 44 hours) { 


2 runway trials and 


ctorially over 
7 reported re- 
the last 20 of 


func- 


ciproe al latencies over 


these tria Differences as a 


amount and 
the 


ind Ssignil if 


tion of both incentive 


deprivation were in expected 


direct on However, 
the these two 


int (F 


interact'on between 


not signin 


195?) 
int 


, in contrast, 
interaction be 
incentive and drive 
in extinction crite 
with no bar pressing, 
lrive—high reward and 
animals ex 

than 


’ } 4 
iow arrive 


reward 
high 
high 
Re ynolds and Pav- 


more raj idly 


rew ird or 


; 
reward animals 


lik suggest that this difference might 
be a function of the different response 
measures employed in the two studies 
bility 1 

For Reynolds and Pav- 
is of the 
In ct 


Another poss lies in the defini- 
tion of drive. 
lik, drive was defined in tern 
length of food deprivation 

trast, Reynolds et al. manipulated 
both fed 

time simultaneously 


would that more 


and deprivation 


In any event, it 


amount 


seem research is 
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needed to specify the conditions of 
both drive and reward under which 
an interaction between them would 


be expected. 
Partial Reinforcement 


Hulse (1958) found a greater run- 
ning speed over the last nine of 25 
daily runway trials when the incen- 
a 1.0 gm. food pellet than 
was a .08 gm. pellet, and 
was continuous 


tive 
when it 


was 
when reinforcement 
than when appearing on only 46% of 
the trials 


speeds over a constant number of ex- 


He also measured running 


tinction trials and found a significant 
the 
reiniorcement 
such 


interaction between effects of 


prior percentage ol 
and 
th if, 


resistance to extinction 


amount ol reiniorcement 


with partial reinforcement, 
was greater 
following a larger amount, but with 
reinforcement, the 


continuous re- 


verse effect obtained 


MECHANISMS OF REINFORCEMENT 


In the introduction, four possible 
mechanisms of Varia- 
tio 


ent 


quantitative 
were outlined: amount of nutri- 
for assimila- 
tory stimulation, 
and 


material available 


tion, preconsumn 


consummatory activity, con- 
stimulation It was 
further that different ex- 
perimental operations produce dif- 


variation 


summatory 
indicated 
ferent combinations of 
Thus, regarding 
nisms of reinforcement must involve 


de« isions mec ha 


nparisons of experiments utilizing 


7 
ct | 


the different operations. 
We actually 


with the conditions of reinforcement, 


are concerned here 
ind a distinction must be made be- 
necessary and sufficient condi- 
If quantitative variation is 
shown to affect behavior when one 
of the mechanisms is held constant, 
this would indicate that variation in 


that mechanism is not necessary for 


tween 


tions 
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incentive magnitude effects. On the 
other hand, lack of behavioral varia- 
that that mecha- 


a single 


tion would indicate 
only 
and 
duces behavioral variations, | 
that variation in that 
But if there 
is no behavioral variation, it 

that that mechar 


} 
or thnata 


nism is necessary If 


mechanism is varied 
t iy 
be com luded 


mechanism is sufficient 


necessa 
oncit 


ire any) 1s lacking ( 


garding me and = suftx 


essity 
1 through comy 
f 


process oO! ¢ 


must be ich 


of studies and a 
experimental 


rd I 
found all four possible 


tion. Because 
imber 


I 


lations of weight ar 


mec inis 


studies of this sort are not cruci: 


the problem 
Preconsummatory Stimulation 
That variations in 
tory stirmnulat 
attested by 
whi h eithe r dura 


preconst' ima 


on are not necessary is 


} ‘ft 
cS ft 


the results of stu 
t've ex 
posure, or concent ion Su,oF oF 
saccharine are manipu In all of 
stim 


ind 


yet behavioral variations, previously 


these cases, preconsummatory 


ulation is presumably constant 
reviewed, have been found 


[wo studies in which preconsum 


ulation 


inipulated indi 


matory visual stir 
pendently m 
hanism is not 


1956 


this me 
Mi Kelvey 
varied the duration of i 
180 sex 


variation in 


ent either 


if tori Aniy 


centive exposure { $s) vs 


ind visual size of the incentive (food 
1-in d | 
umeter during acquisition o 


black-white Dur 


tion of reward affected the periorr 


meter vs. 2-in. di 


‘ 


tray of 


discrimination. 


ince measure, running time, but not 


the acquisition measure, errors 
by neither measure was preconsum- 


matory stimulation shown to have 


any systematic effect on behavior. 
This finding is corroborated in a 
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study of delayed response perform- 
ance by chimpanzees using a modi- 
differential method, by Cowles 
Nissen (1937). In one co 


of their experiment, the chi 


hed 
and dition 

were 
cece 


a large | 


shown either [ 


without 


nie 
skin or a sn with 
] 

skin used 
times 

they alway ind 


the other 


to equate eating 
the delay 
smaller. In 
chi 
shown 
the 


ory stir 


the 
the 
ips found the size 

prior to the de 

first procedure, 
iulation is 
remains cons 
d procedure the 


With 


per entaye 


confounded 
cedure, 


sDO laten ics 


I 
did not differ syster 
f whasher the 
ol whether tne 
’ 


1ses, 
pre del 1y stimu s was 
ie latter 
lifferences were in the 


the 


rve or small, but with tl 


procedure ex 


pected direction and, for ost 
part, statistically sig: 


lmounl of 


A nur 
a d Variatior S 


tude of, 


ber of stucdt« 


incentives which 


ilter the effects ol depr vation 


ate that variation in tl 


rient material av 


ition 1s not a necessary 


ent AY 

tivel 
these studies, by el 
1. 


reintorce! 


naterial is efie 


The pioneer stur 
i that 
Rol rhis 
lemonstrational st 
h 


tives is 
195 


ince 


determine i sacc 


\lthough 


nducted, 


fectively as a ret 
three experiment 
the third w 
For this experiment 


a v maze 


deprived Ss were given 42 trials with 


’ 
my 


kt ood 


position habit in 


saccharine solution in one arm of the 
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the other. 
significant in- 

choices of the 

’ 


side, as well as an increase in rate of 


maze and water in 


T he re 


cre.se 


tap 
developed a 
Sac harine 
ingestion and decrease in running 
time. 

The study of Hughes 


cussed in an earlier section, indicates 


1957), dis 

can rats learn in the 
inforcement by nutrient 
material, but that performance is dif 


iffected by saccharine 


leren 
‘ mh tLiOotni. 


noti- 


[wo studies using sexually 


vated male rats as Ss with receptive 
females as incentive also indicate that 
behavior may be modified in the ab- 
sence of alterations in the effects of 
Shefheld, Wulff, and 


compared 


deprivation 
Bac ker (1951) 


| ven the incentive was either 


pecas W 


running 
} 


ile rat in heat or another male 
though ejaculation was not per- 
d, the Ss ran faster to the recep 
ile than to the 
Kagan (1955 

rect res 


hing speed in a 7 maze 


the incentive was copulation 


male ince! 


tive. found a greater 


perce 
’ 


faster rul 


onses and 


wher! 


with ejaculation than when only in- 


tro Perform 


iISSiO! 
der both of these conditions 
that 
mounting was allowed 
Several studies. 
that, 
administered peripherally, variatior 


ount of 


was permitted 


turn superior to when 
already discussed, 


indicate when incentives are 


in an 1utrient material is not 
mechanism of reinforce- 


1956 


i sufficient 
Kling found running 
} 


ment 
speeds to be unrelated to volume of 


consumed er trial, and 


(1956) 


water 
Feh: Li 


speeds to be independent of amount 


also found running 


of water reinforcement. Swisher and 
Czeh (Spence, 1956) found perform- 
ance to be unrelated to amount of 
food consumed. 

It should be emphasized that the 
conclusion that 


nutrient material, 
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and hence that variations in amount 
of nutrient material is not a sufficient 
condition, applies only to situations 
in which incentives are administered 
peri herally. If we include evidence 
from experiments in which peripheral 
factors are by-passed, then the con- 
clusion must be that variation in nu- 
trient 
tion 

Coppock and Chambers (1954), and 


Miller and (1952). But the 


remaining evidence will indicate that, 


material is a sufficient condi- 


See tor ex imple, the studies of 
Kessen 


when incentives are peripherally ad- 
the 


nism is itself peripheral. 


ministered, reinforcing mecha- 


Amount of Consummatory Activity 
When incentive magnitude is var- 
ied by manipulating the concentra- 
the 
of consummatory activity is presum- 
ably held constant. The studies re- 
indicate that perf« 


tion of sucrose solutions. amount 


viewed i urlic r 
as a function of 


ance does vary su- 
crose concentration, so it would seem 
that variation in amount of consum- 
matory activity is not a necessary 
mechanism. 

However, variation in consumma- 
tory activity does seem to be a suffi- 
A number of stud 


cient condition ies 


in which ingestion rate was measured 
would so indicate. For examy le, Shef- 


field, and Campbell 1954 


found a high positive correlation be- 


Roby, 


tween running speed and ingestion 


rate (incentives were water, sat 


1 


charine, dextrose, or dextrose plus 


saccharine solutions), direct evidence 
that 
function of amount of consummatory 
activity. The Kling (1956) study also 
indicates that the important consum- 


performance is an increasing 


matory activity variable is ingestion 
rate 
Supporting evidence from 
the finding of Sheffield, Wulff, and 
Backer (1951) of a positive relation- 


ship between running speed and per- 


comes 
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centage ol opportunities to attempt 
copulation during which the attempt 
was actually made 


{mount of Consummatory Stimulation 


When 


posure is 


incentive ex 
the 


stimulation ts 


duration of 
manipulated, nature 
of the consummatory 
ilthough its duration 
Several 
Kling, 1956; Spence, 1956) 


tions, 


held constant 


may ary studies of this 


type (e.g., 
found performance vari 
that 


stimulation are 


} 
nave 


suggesting Variations in con- 


summatory not nec- 
essary 

That they are sufficient, however, is 
ndicated in 


a study by Cockrell 
5 similar in design to Gutt 


i's (1953 yulat ng con 


rather than 


but mani 


ration ot sac h 


| 
t irine 
sucrose solutions By his 
ure, the only mechanism assumed 
oO vary was consummatory stimula 
(taste) 


under continuous reinforcement, 


tion During conditioning 


bar 
pressing rates reas hed nonmonotonk 
ptotes as a {ul 
Duris 


rate ol respon lit g was approximately 


tion of concen 


lw extinction ind PR, 
1 


logar 


i linear function of the 
sacch irine concentration 
We may close this sect! 
tentative conclusion that 
mechanisms of reinforcemet 
essary for bringing out performa 
differences as a function of incen 
but that vari 


either amount of consummatory ac- 


itions 


magnitude, 
tivity or stimulation associated with 
that 
By w 
pointed out that there is some diffi- 
culty in manipulating consummatory 


ictivity are sufficient conditions 
of qualification, it should be 


ilation while holding consumma- 
activity constant (cf. Guttman, 
hus it may be that only the 
variation in consumma- 
activity and 
ilation will prove to be sufficient. 


rent 


consummatory 
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[He COMPARISON OF INCENTIVI 
MAGNITUDES: THe DIFFEREN 
TIAL METHOD 
Che term differential, as used here, 
a somewhat broader 
meaning than that originally assigned 
Several differen 
| 


dist yuished 


will be given 
by Lawson (1957 
tial procedures may be 
1. Single Problem thod 
Throughout the experiment there 
but a single task or problem 
the S, but in different st 
experiment he receives 
amounts, for example, iccord 
latin square design. 


Selective 


th it one oft two respo! 


Discriminat 


l ivolved 


Simultaneous 
learning is such 


ses 1s followed 
the other by a 


to dis 


by a greater amount, 


‘ 


lesser amount > must learn 


criminate magnitudes 
Discrimir it 
trials, S makes 


followed by a larger ar 


3. Successive 
cessive 
followed 


ser ond re spor ee 


iller amount 
Probler . \ series 


ol problems are to be learned, each 


} Successive 


problem correlated with a different 
amount Phe learning 
Harlow, 1949 

if example 


noted that 


tive 
paradigm 
vides a famili 
It will be 
the distir n 
differential methods will ay 


py 
the 


ction betwee 


trary. Certainly previous 
' 


cussed training-te phase desig i 


der the abso! ite method involves ex 
posure by the same S to 
one incentive amount 
separate measurements wer 
under each phase of the exp 
and statistical analyses we 
rate In contrast, studies t 
this 


a single 


viewed in section ire 


which analysis is performed 
on data obtained under variable in 


centive conditions for the same S 
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Single Problem Method 

Gantt (1938; also reported in Hull, 
1943, p. 125) presented a curve of 
asymptot« (f conditioned saliva- 
tion in a single dog as a function of in 


}, & 2, and 12 


he curve represents 


centive magnitude 
grams of food 
an increasing, negatively accelerated 
function It is 
that this is apparently the only study 
in the litera- 


interesting to note 
of incentive magnitude 
ture 
tio 


based upon the lassical condi- 


1935) varied 
of ba- 


constant 


Nisset arm der 
both the 


size of single piece 


the nber of 


sessed the effect 


‘ 
' 
he 


iyed response at 
The 


s varied trom 3 


or better 
of grat 


ncreases in delay limits 


increases in incentive 


ind the 


eration efiect the 


amount, reverse \ persev- 
opposite ot col 


A sec- 


study (Cowles 


trast etiects was noted 


ilso 
ond dela. ed response 
& Nissen, 1937) h 
cited They found 


shorter latencies with large th 


is previously been 

fewer errors and 
in with 
tives 


1940 


all inecer 
Fletcher the effects 
of incent 


bar if 


(length of 

performance of 

by chimpanzees 

tive re lationship be- 

y of response and in- 
In add 


res were signil 


ition, Various 
antly af- 
response la 


fected. mong them 


tency, pulling time, and the number 
of tugs per trial 

At this point, Ti 
1928) might be 
He noted in reward substitution ex- 
that ob- 


experil place two 


klepaugh’s early 
study nentioned 


periments when mor keys 


the 
pieces of food under a cup, but later 


served enter 


found only one certain emo- 


tional and searching responses en- 


piece, 
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sued. This behavior did not occur 
when one small piece was substituted 
for one large piece. 

Michels (1957) used a latin square 
design to assess the effects of amount 
of reinforcement (.5, 1, 2, or 4 pea- 
nuts) on latency of response to a 
single test object. The WGTA was 
used and the rhesus monkeys who 
served as Ss were on a 20% partial 
schedule throughout. 
5-peanut reward 
were significantly greater than with 
the three larger rewards, which did 
not differ reliably from each other. 

The 
the single problem method are all 
operant conditioning studies. Jenkins 
and Clayton (1949) allewed a group 
ex- 


reinforcement 
Latencies with the 


remaining studies utilizing 


of pigeons either 2-sec. or 5-sec. 
posure time to the food magazine in 
a counterbalanced order during PR 
and found a faster rate of key-peck- 
ing with the longer duration. Roughly 
twice as consummatory re- 
were emitted during the 5- 


2-sec. 


many 
sponses 
sec. exposure than during the 
exposure 

Following the training previously 
described, 20 of (1953) 
rats were given further PR training, 


Guttman’'s 


each S under each of the four sucrose 
used. A linear rela- 
tionship was found between rate of 


responding and the logarithm of con- 


concentrations 


centration, as had been found with in- 
dependent groups under PR. Ina 
Guttman (1954) com- 
pared the reward values of various 


Se. ond study, 


sucrose and glucose concentrations, 
varied in 
from 2% to 32‘ 

and the 
tween rate of bar pressing under an 


logarithmic 
For both sucrose 
be- 


equal steps 


glucose, relationship 
schedule, and log concen- 
Throughout, 
than 


aperiodi 
was linear. 


with 


tration, 


rate was higher sucrose 


with the corresponding glucose value. 


Two latin squares were used such 
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that any S experienced all concentra- 


tions of one substance but not the 
other 

and Sidman (1956 
tigated the effect of sucrose solution 
bar by 


Each S experienced 


Conrad inves- 


concentration on pressing 
rhesus monkeys 
of seven cor 


to 6ovU' 


each centrations, rang 
/ Phe maximum 
15‘ and 
a decline at 60% Ver 
the effects of 


concentra 


ing from O%, 


rate occurred between 


30%... with 
1956 


h ive assessed 
seven liff nt 


| 


pres ed 


sucrose 


tions to the same rats on 


latency and rate for a two 


har 


ncentrations 


nDonse 


nber pulling responses 


¢ 


varied from 2 , to 


Re sponse rate increased and 
itency decreased as a function of 
concentration, both functions reach- 
ing their asymptote in the neighbor- 
hood of 20-21‘ 

Collier and Siskel (1959 


(1958) h 


concentration 
and Col- 
itten pted in 


ive ex- 


ination of the 


produc ing 


factors 
incentive I 
found with 
i the differential 
method Collier and Siskel varied 
sucrose concentration (4%, 8‘ o, 16° 
and 32%) and PR interval 

ind 4-min.) factorially 

their effects on bar 


Both main efiects 


nonmonotont unctions, 


have been either 


' 
bsolute or 


which 


the 


rats 
their 
The n 
such that the no 
obtained cor 
itself a 


inter-re 


interaction, were sign 


iture of the interaction was 


onotrot city oft the 
centration function was 
ction of the 


Collier 


decreasing fur 
nforcement interval 
1958) discusses these and other dat 
and concludes that a nonmono 


Bee By 


relationship will most likely 


under any of the following cond 
n extended test-session, large 
(Hughes’ [1957] study 


assertion), high concentra 


tions 

volume veri- 
hes this 
tion, or short time between reinforce- 


ments. 
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Simultaneous Discrimination 
Festinger (1943) allowed rats 10 
sec. exposure to whole wheat grain in 
one arm of a discrimination bo« and 
By 


the end of 96 trials, the rats were re- 


l-sec. exposure in the other ar 


sponding on free-choice trials to the 


side with the greater exposure time 


at an above-chance level 
King (1955 
with 7 Viti 


a T maze 


Denny at d 
the 


replic ited study 


reward in one goal box of 
ind 


s4 


} 
‘ 


l-gm. in the other. By 
training trials, a prel 
ie larger reward side had 


devel 


Discrimination tri 
d by 
ifue and 
By the « 
reversal trials the Ss were r 
the oO; ! tl 


side Wit 
greater 


ininy 


was Lniny, 


reversal tr 
1? 


t 
li reward 


lof 72 


with the smal 


sides interchanged 
posite 1a 
than chance 

Pereboom (1957a) gave rats two 
hoice tri 


ith 


d two forced 
1 Tm 
Five food pelle 


side, one o1 ¢ other 


iree- al 
day in 


days 


ils per 
10 or 21 


ts were found 


ize for e er 


on one Follow 
this training, 
rewards had their 
tila total of 35d I 
!. Asa third stage of the exper 
for an additional 12 days 


were e¢ ialized ‘ 


nounts ] 


IMs d ivs, 


respor ding consistently 
side Reversal, 


d Kir “ 


lete 


reward 
Denny at study, 
by the e 
During the subs 
ward-equalization pl 
tended toward ch 
The gradual revers 
Denny and King 
to be contrasted with the abr 


formance changes found when incen 


tive iltered in the 


this 


magnitudes are 
runway Pereboom interprets 
inconsistency in terms of competing 


exploratory behavior which retards 
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reversal learning, and would be ex- 
pected to be greater in the more com- 
plex T maze than in the runway. 
Wike and Barrientos (1957) held 
amount of nutrient material and 
consummatory stimulation constant 
while allowing only duration of con- 
activity to vary. This 
varying the di- 
ny tube from whi h 


summatory 
was ichieved by 
ameter of a drink 
wentive (for thirsty rats) 


With the sm 


consummatory 


the water | 
was to be obtained iller 


more ac- 


di imeter 


tivity was required to attain a con- 


The two di- 


stant amount o! water 


pitted against each 


a ey maze 


and the rats were required to learn a 


ameters were 


other in opposite arms ol 


position discrimination on this basis. 
ty the end of the 27 daily trials 
given, 85% of responses were to the 
the 


significantly 


smaller diameter, a 


abx ve 


side with 
le vel chan 2. 
7 hese re sults nicely confirm an éar- 
lier concl that 

‘ither amount of nutrient material 
stimulation 


variations in 


Isio! 


consummatory are 


but 
ictivily 


variation in consum- 


necessary, 


s a sufficient mecha- 


Successive Discrimination 

D'Amato 
on a successive dis rimination prob- 
that on half 


ils a larwer incentive was asso- 


1955) gave rats training 


lem in 1 runway such 
the tri 
ciated 


while on the other 


a goal box of one color 
half 


Ass iated 


with 
a smaller in- 
with a dif- 
ferently By the end 
of 70 training trials, the Ss were run- 
faster for the 
for the smaller 


centive was 


olored goal box 


significantly 
larger reward than 
Csreene (1953) employed a design 


nins 


utilizing successive discrimination 
during 

taneous discrimination during a test- 
By a factorial design it was 


per- 


phase 


possible to assess learning vs 
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formance effects. During the train- 
ing-phase, rats found either a large 
pellet in a black goal box and a small 
pellet in a white one, or the reverse. 
During the test-phase, either a large 
or a small reward was found in the 
black arm of the apparatus, the 
white arm being empty. Number of 
errors and number of trials to crite- 
rion during the test-phase were sig- 
nificantly less for the animals having 
the larger with 
black during the training-phase, but 


performance did not vary systemati- 


reward associated 


cally as a function of contemporary 
amount. This result is flatly counter 
to test-phase results reported earlier 
using the absolute method. Here we 
have evidence for a persistent effect 
later 
inter- 


of training-phase amount on 
performance, which can be 
preted to mean that, with the dif- 
ferential method, amount of incen- 
tive affects learning. This conclusion 
will be verified in subsequently dis- 
cussed papers. 

Powell and Perkins (1957) manipu- 
lated duration of incentive exposure 
successive discrimination 
found it to influence 
discrimination _ test- 
confirming 


during 
training and 
simultaneous 
phase performance, 


Greene's results. 


Successive Problems 


Experiments in which Ss are 
trained on a number of consecutive 
problems, with different incentive 
magnitudes associated with different 
yield evidence 


affec ts 


problems, clear-cut 
that 
learning. 

The first, and probably the most 
significant, of these experiments was 
published by Meyer in 1951. Meyer 
rhesus monkeys, highly 


incentive magnitude 


trained eight 
sophisticated on several tasks includ- 
ing discrimination 

series of 64 different 


reversal, on a 
discrimination 
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the WGTA. 


a single pair of 


reversal problems in 
Each problem used 
objects throughout in original learn 


and four reversals 
to the correct 
ot 


reversal but 


ing phase 
(ABABA Response 
ject vielded a constant amount 
entive tor any give 
uunts over ft 
t problem 
reversal 


fol 


le Ww 


postrev 


pwostreve 


mbiguous 
nceeptive amount al 
iS we | as pertorn ince 
The sig 


that th 


' 
ft learning 


nifical iteract 
effects of 
amounts are not independent of ea 


ons imply 


pre ind 


postre vers 


H. PUBOLS, 


IR 


other. i 


ence was apparent on early problems 


only By 
periment, the 
binations of 

ts were ordered in thei 


most to le 


the termination of the ex 


four treatment < 


pre and postrevers 


an etiect 


ist errors, as follows 
1-1, 3-3 d 3 
cates p » ler gy last 
both 
ire slow to develop 


Mever el 


criterion, a meast 


lhis orderi 


efte« ts 
that 


ure 


positive il 


’ 
piove 
I 


ire 


represt nt effects on le 
the results of the exper 
suggest the {x 


tive mag! 
Ss experice! 
stud 


if 
1; ' 
bis 


rf 
rift 
I 


ignitu 
difterer 


is Tt 


} eved., 


problem learning en 
receives 
pendies Tha 


The 


I} S cf nclusior 


fro 


i more recent § 


and Harlow (1956 


discrimina 


effects of 
or tour gm. pellets 
ficult practice, 


mea perce! tage ( 


lava monke 


Six 
; 


it subsequer 
irves diverge 
asymptotes are 


Schrier 


learning process is involved whicl 


the 


response 


and Harlow say, 


fluences 
turn, the 


percept ol 
to, ¥ 
of incentive, and that suc 

ing per se’’ (p. 120 

Meyer and Harlow (1952) i 
gated the effects of incentive amount 
1, 2, 3, or 4 units) on delayed re 
sponse performance of rhesus mon 


However, this nonindepend- 
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keys, using the WGTA. Percentage 

“4 4 
of errors decreased with increasing in- 
and the 


function changed with practice from 


centive amounts, incentive 


one with slight positive acceleration 
to negative acceleration 


Davis (1956) reported results of 
0 experiments on problem solving 
He found that an in 


rmount led to ar 


monkevs 
1.€ decrease in per- 

ses), but no change 
il size dis« rimina 

I he unex pec ted effect 
irently due to satia 

larger I ints 

a re luced-cue 

3 produce l fewer 


it there were 


balks 


lly, Leary 1958) compared 


four conditions of reward in their ef- 
ation learning 


j 
ll- 


fect on serial discrimit 
The four con 

nal to four 10-pair lists 

were: two pea 

i list; one-half 

two peanuts for 

for the other five 

two peanuts ior two pairs, one 
half peanut for the remaining eight 
The two homogeneous reward condi- 


tions led to performance superior to 
the 


butable primarily to 


neous reward, 
errors on sm ll reward 


nder the two conditions 


Comparisons Studies 


studies, although employing 

ns on the differential method, 
do not fit into any of the above cate- 
gories. [hese are paired-comparisons 
studies of food prelerence as a func- 
tion of magnitude. Harlow and 
Mever 1952 gave seven naive 
rhesus monkeys 400 WGTA trials in 
which they were to between 


two peanut amounts: }, 4, 1, 2, or 4 


( hoose 
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This gave 10 pairs. Result- 
choice were 
values by a 


peanuts 
ing 
converted to 
method similar to 


percentage scores 
scale 
Thurstone’s Case 
III, resulting in an increasing linear 
relationship between scale value and 


Fay, Miller, 
their 


log incentive amount 


and Harlow (1953) had mon- 


keys choose between a preferred qual- 


ity (peanut or bread) and a nonpre- 


ferred quality (potato), when each of 
five values of the preferred was paired 

two values of the 
rhey found that, 
preferred to nonpre ferred 
from 1/64 to 1/2 
hoices of the preferred food in- 
the 

upon absolute 
but their 


with each of non- 


preferred as the 
ratio ol 
amount increased 


the 


cre ised 


Further, percentage 
choice depended, not 
mpared, 


amounts co upon 


ratios 


Comparison of Al 
tial Methods 
Several studies afford a more direct 
comparison of the absolute and dif- 
ferential methods than has been pos- 
sible in 


that the two methods are compared 


studies reviewed so far, in 
within a single experimental design. 
Logan, Beier, and Ellis (1955 


mare ! 


com- 
luring acquisi 


speeds « 
tion when the incentive was nine 45- 


rats, 


runway 
five such pe 
and, for 
a random half of the trials and one on 
the other half Thus, the first 
groups were tra ned acc ording to the 
absolute method, the third according 
to the differential. Over-all running 
60 daily trials) was greater 
for the first group than for either of 
the Inspection of their 
Fig 
of approach to terminal speeds in all 


group of 
group, 


ne pellets on 


px llets for ne 
llets for a secor d 


a third group 


two 


speed 
other two 
2 (p. 264) indicates similar rates 


Cases 

In a follow-up study, Logan, Beier, 
and Kincaid (1956) report the extin« 
tion results of this and a related ex 
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perime For the first experiment, 

none of the three groups differed in 

their relative rates of extinction. In 
extinction 


the iment 
with 


related exper 
foll wed 60 


pellets on each trial, nine vs 


acquisition trials 


nine 
zero each on a random half, or nine 
two varied- 


In this case the 
differential metho« 


mnstant-amount 


vs. one 


amount 1) groups 
were superior to the 


The conclusion seem 


group. would 


to be that relative 
by 


rate of extinction 


is retarded previous comparison 
ntive vi 


1957 


ol Ince al ies 
Lawson ussessed the effects 
of incentive magnitude on discrim- 


tion learning by having rats learn 
two proble ms com urrently, a black- 


iti and 1 white- 


discriminati 
ation, gray being nega- 
ve in both insta! Ss 
correct 


either 


Wray mn 
ray 


aiscrit 
ces I or some 


le for 


reward s the sa 
both problems, 
r one pellet 

s the reward was 


one problem and one 


onses O 


' 
' 
ve I 


1] ibso! ite 


’ 


eiiets or 


} or other H 


groups 
‘ 
ve peliets on 


ther 


differential 


ibsolute groups 


1 eas h ot} 


ward 
le sign to 
Schrier 


studie 


exper 


received 


each 
experiel! 
od pellets It col 
trast, membe of fo 
ite groups received experience with 
of the fou In 


first study 1956b), effects were 
the late \ res 


with 1, 2, 4, or 8 fe 
rs ol each If abso- 


nly one r magnitudes 


nm ponse 


tle object covering a baited 


food well. By either method, per 


B. H. PUBOLS, 


IR 


improved as _ incentive 
amount increased. However, the ab- 
solute and differential did 
not produce differences in over-all 


and the slopes of the 


formance 


methods 


periormance, 
functions relating’ incentive magni 
signi 


tude to latency did not differ 
(1958 


cantly. In the second study 
effects on errors during a 


series of 


discrimination problems were 
groups did 


periormance 


two 
all 
ol 


sessed Again, the 


not differ in ove: 


However, the sloj i the 


was signihcantly 
itial method thar 


functio yre 
liere 


method 


the di 


absolute 


ACQUIRED REWARD VALU! 
FUNCTION OF INCENTIVI 


MAGNITUDI 
I xperil ental studies of sec« 
ment were recent! 
On the I 


discussed 


reiniorce 
by Myers 
evidence he 
1955; Hopkins, 1955; 
Myers concluded that, 

ct of amount ol 

only be detected 


he twee 


1958 
Law ba 


} 
ie rewar>ra 


that it 
S ms te rced 


oose 


to « 


ondary reinforcers prev yusly 
ciated with different sized rev 


294 


App ured 


e finding was tl 
nly when tr 


} J 


differential 


nat 
second 


iry rew 


either method was ; 
fect of 


secondary 


primary reward 


reward stren 


strated 
Howeve r, a study 
Thomas (1958 
vethod, indicates that perhaps 
be rev 


the 


by 
using 
should 


ers’ conclusion 
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During training, click was paired 
with the presentation of either 8% 
or 16% sucrose solution, and during 
testing, bar pressing produced the 
click. The 24% group emitted sig- 
nificantly more responses during the 
test than did the 8% group, indicat- 
ing a differential effect of magnitude 
of primary reward on the strength of 
secondary reward. Butter and 
rhomas suggest that the earlier fail- 
ures with the absolute method might 
be due to the possibility that the 
primary amounts were too large, to- 
iptote of the primary 


ward the asy: 


reward amount function. 

it does not look as if any 
mons can be reat hed 

com- 


lesit 
design 


research has been 


more 


pleted, for 


| example using a 


to Lawson's (1957), allowing 
direct co! p of the 
and diflerential methods 


ment that can now be 


similar 
irison absolute 
Perhaps 
the saliest 
npirical generalization 

of primary reward does 

if secondary reward, 

fect is more likely to 

i the differential method 

resentation is used 
s section might be con- 
ention of Wolfe's original 
i-reward (1936 
lifferential method in 
ot a toker 
grapes, a toket 
, and a brass toke: 


‘ i} . 


ts on toke 


blue 
white 


nothing. Three chimpanzee: 


learned to consistently choose the 


blue token, demonstrating that se« 
ondary rew ird 


V ilues can be dis 


criminated, just as primary reward 


values can 


SUMMARY AND “ONCLUSIONS 


significant find 
ing of the relatively 
high degree of consistency of results. 
The and 


Perh ips the most 


this review is 


facts seem well . ordered, 
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where contradictory results are 
found, such disagreements can usu- 
ally be fairly readily explained in 
terms of procedural differences. The 
empirical laws are now before the 
theorist, for him to explain in what- 
ever logically consistent way he can 
devise. Because the findings seem so 
well ordered, he should perhaps have 
less trouble than in other aspects of 
behavior theory. 

We may conclude by bringing to- 
gether the 
eralizations scattered throughout this 
paper, and offering some suggestions 
rhe following 
from 


various empirical gen- 


for further research. 
generalizations have emerged 
the review of the evidence on incen- 
tive magnitude 

1. With the 
quantitative variation in incentives 
apparent effect on rate of 

A possible exception in- 


absolute methad, 
has no 
learning. 
volves the manipulation of concen- 
tration of sugar solutions. A second 
exception is that 
rapid with any 
umount than with zero amount. 


learning is more 
positive incentive 
2. Asymptotic performance is an 
increasing function of incentive mag- 
nitude. The function is negatively 
iccelerated, and possibly logarithmic, 
although under some circumstances, 


nonmonotonicity appears 

3. These asy mptotic differences re- 
flect a direct effect on the level of per- 
formance, rather than an indirect ef- 
fect based on differences in amount 
learned. 

4. Magnitude of reward affects re- 
sistance to extinction § indirectly 
through differences in terminal level 
of rewarded performance. 

5. There exists conflicting evidence 
on the interaction of incentive mag- 
nitude with drive level. 

6. None of the mechanisms whereby 
quantitative 


behavioral results of 


variation are effected are necessary. 
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7. Sufficient mechanisms seem to 


be amount of consummatory activity 
the 


consumm 


stimulation from incentive 


with 


and 


associated itory ac- 


In the former case, it is the 


tivity 


tivity. 
rate of consummatory a¢ which 
(This set of con 
| 


iusit 


seems paramount 
n trom 
ol 
pe 


of administration 


substances other than 


consideration 

nutritive 

riphe rally 
8. With 


ncentive 


differential method, 


the 
magnitude affects learning, 
but only after Ss have learned to dis- 
riminate ar 
9 [he as 
is steeper when trai 


rential method t 


ic 


I 
| 
| 
i 


-asures ol 


H. PUBOLS, 


JR. 
fected by incentive magnitude, and 
not time-independent measures. This 


} 


correlation supports the distit 


and a more widespread adopt is 
recommended. 


I his 


does not imply that the s 


multiplicity of 
centive magnitude is a 
The conclusions are o 
to modifi 

must be 


tha 


ition, and 
accepted 
others 


resear©rt h st 
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The primary task of clini liag perience, it would be well to make one 
nosis is that of collecting, eval ig or two observations for purposes ol 


and assimilating information clarification. In the first place the 


respe t to the patient The arting term mental pro« ess is often directly 
| 
may be in the form of laborat: But as private experience, the men- 


test results, biog: iphic al data, scores tal process is not observable 


wint is the ir n ion itsel s equated with subjective experience 


on psycholog cal tests, manilest acceptance of this definition places 
symptoms, or other observables The the process beyond the realm of 
end result is a judgment; this may legitimate scientific inquiry, except 
take the form of a recommendation as it may be inferred from observ 
nt or discharge, able phenomena such as verbal re 
at certain other data are sponses And since no criterion cat 
necessary before final judgmer exist for the validation of inferen 
made, or a classification of the p: concerning subjective experi 
tient WW li j . inferences are simply ways 


What vel tween inning ing agreement in the use o 


ind e1 1s, cl nicial ( » or other symbol resp. 
the subject and the observer 

observer makes “good” 
concerning a subject, tl 

al i descr most 1 consensu 

tween them with respect 

MENTAL PROCESS bee behaviors 


standing 
subjective experience 
beyond this level 


may be alternately 
be considered is 
neurological, biochet 
esses; al ce mental pr pabl 
have o . d plac el 
logical 


} 


ye sure, these techniques have 
little that sati 
itive mental 
is perhaps unf 
follow that the 
Improvement 
niques ol measuremet 
application of more exp 


els may ultimately 
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progress, even though this may seem 
remote at the present time. This sec- 
ond definition is not unreasonable by 
known and it may 
surely encourage productive research 


any standard, 
and a resulting clarification of basic 
issues. But it is perhaps too early to 
say 

This brings us to the third sense 
the 


may be employed 


mental 
It should first be 


in which term process 


pointed out that any realm of sci- 


entific investigation is designed to 
provide, among other things, a use- 
ful level of 
Direct 


mentation, 


objective desc ription 


observation, instru- 


other related 


testing, 
and tech- 


niques are in this direction 


W hen proper ly 


framework 


ate ps 
employed within a 
theoretical they seek to 
describe relationships between events 
or phenomena. The problem of de- 
an similarly be 
which inter- 


scribing judgment ¢ 


considered to be one 
poses a set of te h ques and a the- 
oretical system between two sets of 
Thus it is possible to 


kinds of 


tivity usually characterized as cogni- 


observ ables 


describe" the mental ac- 


tive by means of mathematical 
models. One may thereby approach a 
level of description which is at least 
equal to that of other competitors in 
some respects, and certainly superior 
n other ways That is to say, im con- 
trolled situations wherein the input 
nlormatior and the output (judg- 
nent 


} are known or ¢ apable of quan- 
tihcation, 


postulate func- 
input 


ade- 


one may 


tional relationships between 


and output and assess their 


quacy by determining the accuracy 
with which each is capable of pre- 
dicting judgment. The present paper 
is directed at this level of description. 
Che refers 


simply to 


mental 
a functional relationship 


term process 


whi h accounts tor consistencies in 


response to divergent stimulus (in- 


formation) patterns. It is thus a set 
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of intervening variables, nothing 
more. 

A question which 
arises from the foregoing discussion 
is that of the adequacy with which 
it is possible to describe the mental 
underlying judg- 
ment. In answer it may be said that 
the process is adequately described 
mathematical 


immediately 


processes clinical 


when a_ particular 
model quite effectively predicts judg- 
ments for any given set of informa- 
This is with the 

meaning of the word “‘de- 
although 
such as simplicity, generality, and 
the testability of derivations must 
be kept in mind. A major problem 


tion consistent 
screntin 


scription,” considerations 


in the understanding of judgment 
will in this paper be considered to be 
that of the kind of 


wuich is sufficiently predic- 


formulating 
model 
tive, yet useful as a vehicle for ap- 
proaching other related problems in 
the area of Different 
kinds of dis- 


( ussed, 


judgment. 
models neec to be 


compared, and evaluated, 
and empirical findings are of course 
Subsequent sections of 


will 


necessary. 
this 
models for 


consider specific 
judgment One, the 
linear relatively simple; 


another to be described is somewhat 


paper 
model, is 
more complex. Following this, some 
empirical findings will be offered as 
illustrative of the research 
tunities which unfold. 
Before beginning the 
of specific models, however, it be- 
justify certain 


oppor- 
discussion 
comes necessary to 
restrictions that 
that meaningful 
made into the judgment 
process. The restrictions center in 
the nature of the information avail- 


must be imposed 


in order inquiry 


may be 


able to the judge or clinician and 
which the judgment is 
tingent. The restrictions do 
seriously impair the realism of the 
judgment situation as long as one 


con- 
not 


upon 
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bring some ingenuity to bear 


certain problems of quantifica- 
this 


can 

upon 

view 
For 


tion, but even point of 


may be objectionable to sore. 


completeness, therefore, and in order 


to provide early insight into the ex- 
perimental procedures used in the 
studies to be later de- 
now be di- 


empirical 
scribed, attention may 
rected to the problem of the nature 
of the available to the 


judge. 


information 


THE INFORMATION 


Che information upon which clini- 


cal assessment is based may com- 


monly be expected to include any- 


thing or everything, depending upon 
the the 


diagnostician, upon 


training and inclination of 
and depending 
easily obtain- 


what is available or 


able 


niormatior 


The lack of control over such 


may be considered an 
isset or a liability, depending upon 
and the accuracy 


yne's orient ition, 


of judgment may or may not be en- 

hanced through the inclusion of non- 

1uantitative data (Ullmann & Berk- 

man, 1959; Holt, 1958: Luft, 1950; 

Meehl, 1954) depending the 
i situation 


seems certain, regardless of 
- 
] 


upon 
dgment a lain or 
What 


outcomes of empirical research, 


; that the uncontrolled use of clinical 


lata, whether or not it exists 
itive form, makes clin 
t an artistic venture. 
se remain a matter 


values as to whether this 


What seer 


‘riously cor 


1s equally certain 
ducted sci 

f judgment which has as 
its purpose description of the 
method of combination used by the 


must take pl ice in controlled 


juage 
in such a way that the 

1, and nature of the in 
available to the clinician 
or judge can be completely specified 


in objec tive terms 
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Controlling the judgment task to 
this degree has its advantages and 
its liabilities. On the one hand, re- 
stricting the 


assures that each person is evaluated 


situation as described 


with respect to the same informa- 


tion. Ambiguous and equivocal cues 


are removed, and all judges are 


thereby certain to have at their dis 
posal the same information and no 
more. The inferences made beyond 
this point are thus certain to have 
their the 


The major problem, that of describ- 


origins in data provided 


ing the idiosyncratic method of con 


bination and weighting 


formation by the clini 
by clearly defined ( 

ments are, of course, oO 

settings wherein the kin 
mation available may in 
view and projective test 
In additior 


information available 


impres 

sions, etc. the ki 

siderably from one 
T his 


limitation to the situatior 


patien 


next may be said 
1 described 


Such information may be important 
a point perhaps best 
1958), but ur 


judgment sit 


in judgments, 
Holt 
clinical j 
make the contribut 


initorn 


struc 


made by 
tured itions 
nonetheless 
of such ition exper 


Phe pre 


here under investigation woul 


impossible to assess 
result, cease to be a scientifu 
lem altogether 

Let 
situation in which a « 
pat cl 
following ways: (a) the in 
1 toa 


us therefore « 


eval lations of 
l ihe 
formation available is reduce 
variables with re spect tow hich 
nts in the sample are evalu 
the 
numbers or in c: 
hy 


all pati 
ated: b 


pressed in 


inforn itor 


responses; and (c) ea 
satishes aS a minimum the 
ties of an ordinal scale. This 


leads to a set of numbers or classifi 
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cations for each patient, where each 
number or class represents the de- 
gree to which a characteristic, trait, 
symptom, or biographical factor is 
present. One example of the situa- 


tion satisiying restrictions 1s 
check list; an- 
other is that of a test profile Rating 


scale data are likewise permissible, as 


these 


that of a symptom 


would be combinations of these 


twne 
vpecs 
’ 


Hav ,’ 


which 


the data 


judgments are to be 


objectified upon 

the 

now turn to a consid- 
= 


‘ model 


based, w may 


LINEAR MOopE!I 


odel is one in which 
re described 

of the 
available For a 


is a simple 
the 


given 


values of 


ng a number of people, 
niormation 
These 


nt variables. 


are 
will, of 
4 intormation, 


del can be de 


k 


i weighted 


te 
+ 1,X, 
is to Vie ld the 


im, ¢., so 


correlate 


scores 


the model is 


where | the 
} 


ipphed to the inde 


' 
so cl 


iriables are 1o0sen as to 


he error in estimating an 


ndent variable from the 


| r omposite 


weignt 


Application of multiple regression 
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procedures to the problems of judg- 
ment has been suggested by Bruns- 
wik (1947), and by Hammond (1955). 
Todd (1954) reports a study using 
regression coefficients and the multi- 
ple correlation coefficient for a de- 
scription of the judgment 
process, where the task was to judge 


clinical 


intelligence from a selected number 
of Rorschach While such 


studies provide interesting implica- 


signs. 


tions, it should be stressed that there 


are serious limitations with respect 
to the 


limitations which may be minimized 


interpretation of results; 
or overcome only through a detailed 
the rationale under- 
the through re- 
formulations or the 
model, should this be necessary. So 


examination ol 
and 
revisions of 


lying model, 


as to insure the appropriateness of 
the device for 
characterizing the judgment process, 
1 detail 
provide the particu- 


linear model as a 


we consider i some of its 


properties, and 


lar reformulations where necessary 

In the first place, and by virtue of 
the experimental control employed 
data, the 


judgment 


in the collection of the 
reliable 
variance is from the 


This is in objective form, 


only source of 
information 
supplied 
e.g., it appears as a number, a desig- 


nated 
continuum, ets 


category, a along a 


Often these data ; p 


position 
pear as test scores on a set of proto- 
cols being judged. Assuming that a 
judge combined the information u 
linear additive fashion, the multiple 


regression analysis will be quite ef- 
a tool for describing the 
the set of 
regression weights when applied to 
the can 
quite properly serve as a mode! for 
Thus, the 


the linear model can be assessed by 


fective as 


judgment ; 


process, - - 


corresponding predictors 


judgment. adequacy of 


inspection of the magnitude of mul- 
tiple R. If the 


in additive fashion as opposed to 


udge integrates data 
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configurational or pattern analysis, 
the linear multiple correlation will 


approach unity when corrected for 


Lesser values of R& sug- 


progressively lesser 


attenuation 
gest utility tor 
the linear model. 

Secondly, it may be that 


the regression weights signify, with 


noted 


certain limitations, the emphasis or 
importance attached to each of the 
variables by the judge 
n, empirically, 


predictor 
Large coefficients mea 
that the corresponding predictors can 
account for large proportions of the 
variance of judgment; and a 
dictor 


contributes 


pre 


small beta coefhicent 
evyorn i¢ 

t 1 ti 
predictors. In 


the 


with a 


little con- 
f 


tribution of other 


practice, characterization of 


judgment process by means of beta 


coefhcients has three limitations 


z) since Js differ with respect to the 
size of their multiple R, direct com- 


parisons of sets of beta coefhcients 
between /s is not meaningful; (6 
hcients do not account 


beta coe! 
ill the pred table Variance: and 

a coethcients do not allow for 
the independent con- 


What 


would be more appropriate would be 


the 


assessment ol 


tribution of each predictor 


a set of weights which are compar 


able from one J to the next. which 
are apable theoretically of account 


ing for all of the predic table variance, 


and which carry exact interpreta- 


tion in terms of components ol 


1} Vafri- 


ance, 
RELATIVE WEIGHTS 
7 he 


is fortunately 


formulation that is required 
difhcult Beta 
converted into 


not 
weights (8,,) can be 
a set of relative weights (w.,) which 
have all the advantages described 
We first that the 


predicted scores (which in this paper 


show variance of 


refers to predicted judgments can 


be partitioned into two sources; one 
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a sum of squared beta coefficients, 
and the other a residual of weighted 


covariances 
Let 


x’,=the predicted score for an in 


dividual protocol in reduced 


standard form. 


the «th 


’ 
‘ 
] 
i 


x,=the standard score of 
the 
the beta coefficient for the ith 


predictor (on 


protoco 


predictor. 


y i : 
I Sa. 1 
;-_oa.CtC«C< 
in pare 
Coy 


It can be divided 


Variance 


wher squ ired ; 
dividuals, | 


5 coett 


since the xX, 
Similarly, the 
a weighted sum of the 


tions 


Secor! 


the predictors 


ImMong | 
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& I! 


?P ss > BBo XX; 


tl fl 
N 
’ 
Therefore, 


i & bk! 
o*, m  » 8764+ > > Bo Bof x2; 


i tl jel 


> 
BeBe if xia; (t>y7) 
pm 


It follows that the variance of pre- 
dicted scores is described by a simple 
sum of squared beta coefficients if 
and only if the covariance terms 
vanish. One special case in which 
this will be true is that of orthogonal 
predictors 
ght, w.., is defined as 
note that 


Relative wei 


follows | irst we 


BaFos Ro 12 


¢. 
7a 


Squaring both sides and dividing by 


y we get 
: 
“ 


Therefore; in inde- 


pendent components of variance, we 


interpreting by 


express relative weight as 


Bus. 


where 
8.,=the beta coefficient for 
the «th predictor 
r..=the validity coefficient 
correlation with judg- 
ment) of the ith pre- 


dictor 
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R*os.a..2=the squared multiple 
correlation coefficient 
reflecting the best lin- 
ear combination of the 
k predictors in predic- 
tion of judgments. 

Finally, a description of the judg- 
ment process by means of linear re- 
gression procedures and_ relative 
weights allows one to go on to studies 
of varied sorts. Judges may be com- 
pared and contrasted with respect 
to their characteristic equations; and 
differences among judges may be re- 
lated to training, personality, and 
other factors that could conceivably 
affect the utilization of data. Many 
other problems immediately suggest 
themselves. 

The linear model 
be able to pred t 
cal judgments to a very considerable 
degree, but there may be other situa- 
for which models 
not appropriate 
be many judges for whom more com- 
plex models are necessary. Let us 
now turn our attention to a second 
type of model 


effectively 
clini- 


may 


(or des ribe 


linear 
just as there must 


tions are 


CONFIGURATIONAL MODELS 
In very general terms, the config- 
urational model can be described as 


J =f( Xi, Xs, Xa, - + + Xi) 


wherein the exact functional rela- 
tionship involving the k independent 
variables may be described in any of 
a number of ways. As an example, let 
us consider a particular type of func- 
tion, one which shall be referred to 
as an interaction model. The interac- 
tion model describes judgment as 
an appropriately weighted composite 
of all possible first order interactions 
of the predictors. Thus we may write 


& b-I 


J=Aet DD AwXiX; 


tl j=l 


(i> 7) 
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; 


he inclusion of interaction 


terms rse be expected to adifter 


in a model takes account of the pos- themselves. For some. sc¢ 


sibility that for a particular judge the or be 


interpretation olf one item ol informa ry 


tion mav be contingent upo! 1 sex 
ond. By extension, other interaction 
odels suggest themselves Thus it 
possible to include terms involving 
h gher order I 1 ] or other 


5 


relationships 
Val ibles 


i: 


SSeS 
more “Cisive 


scores in the 


‘low some arbitrary v: 


no added significance whatso 
In sele ting conhgurat 
or stt 

lecessary 


divid 


that type 
irs most promisi 


of such a mo« 
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the second 


pre- 


ressor It carries 


ip} 
it beca ise it accounts 
first predictor 
t of the criterion 


not ade- 


nt 


wo ild 
proc - 


would be 


d predict 
iiormation to 
possible, 


ol 


addi 


a set 
dd 
rrelation 
ind 
it well yield signin 
hts obvi- 


tl example 


1.000 


ne is 


} 


ISAt i 
hool 


high s« 


these two 


urn 


out 
weight by 
ve though 


the 


proto 


; 
st 


be 


f 
yh 


seen ri 


partial cor 
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relation, and with reference to the 
If 


is attributable exclusively 


extreme case the validity coef- 


hcient 
to 


r 


a second predictor, 


0) 


that 
in fact 
ol 
with 


therefore 
lefined do 
de ~ riptions 
1.¢ 

nport 

nio;rt 


ance 
lation 
without 


ts 


olten 

regression 
would seem 
itical prool 


rt difficult to 


\MONG MODELS 


becomes ap- 
that 


be « apable 


recognized 
may 
idgment variance 
(onsider, for 
lel which is 


licting judg 


| given. 


formation 
1ay be said to have 
the 


n 


des ribed”’ 
but 


( hara terized 


judgmental one i! 


process, 
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portant qualification necessary. 


Even in the hypothetical situation 


is 


in which prediction is perfect, one 
that the 


process has been ‘“‘discovered.”’ 


mental 
By 
definition, of course, this point should 
well to 


among sets of mathe- 


cannot conclude 


be obvious, but it is 
that eve 
matical relationships 
different, 


point 
out 
models) which 


are ostensibly there may 
be some which are in fact equivalent 
with explanatory 


\n example may serve to clarify 


respect to power 
Let us assume that for a 
two informa- 
Y, the judg 
can be independently 
from X and Y 


, 1] : : 
by the following equation 


this point 


given judge, and for 


tion 


ments 


variables, X and 


pre- 


dicted with 95% a 


curacy 


We note that the right hand term is 
simply the square root ol the bi- 
ial X+Y Since X+Y 
X?+ ¥?+2X Y, it follows that 
ion J’=X+Y 


ents equ ally 


+ 
lat will account 


as well as 
X*+ Y?+2X } 


is therefore no more reasonable to 
that the fact 
one particular combination 


onclude judge is in 


“using” 
of the information than it is to con 
clude that he is using the other. One 
would have to establish different cri 
teria 
such rey 
gently mac 


But 


some 


two 


be intell 


before a choice between 


resentations 


| 


may 
this should not be a trouble 
Mathematical 
provide a 


models 


point 
scheme 
be 


al 


are designed to 


whereby one set of events may 


satisfactorily predicted trom 


other, and whereby testable deriva- 
lead to 
theoretical understanding of the phe 


Such models therefore con- 


tions may more complete 


nomena 
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ind ex- 
ntiti 
ol 
nblance 
afiairs, 


stitute a level of description 
planation which suffices for sci 
It 
models that they bear any s« 
ol ol 
either organism 


this 


purposes is not required 
“actual” state 
the 


would 


some 


within or else- 
nor 
lead to a 


nature 


where, necessarily 


better ur 
be more cl 
relation to an example fron 

A chemist has t 
a substance 

ol 


This: may 


i al sciences 
of describing 
number 
the 


forms a operat 


tests) on substance a 
its chemical compos 
turns out to 


The 


‘ hemi ally . 


mines 


be a relatively 
substance 


as Cal {) 


task 


is not compl te, fora d 


operations (or tests) might 
i different 
which may 
the 


more suitable for o 


level 
not be 
but which 


| ne 


me 
chemist, 


ther con 


Sary tor 
texts 


mineralogist, for example, would per 
series of tests to me 


form a 


opti il properties ol the cr 
he might examine its hardne 
bility 
crystals identified by 
CaCO, might fact 
different 
fe ineralogist, 
and the other 
" 


crystals ao 


and other characterist 
in 
irom 


in fact 


chemical struct 


r 
it 


in molecular structure 
vealed bs optical and other tests 
that levels 


with 


different 


ot 


reg ird 


is apparent 


dese ription ire possible 


to substances, and that each 


peculiar advantages and 
ings 

In mineralogy, « te is 
described as a paramorph of arago- 


nite. This word is used generally to 


describe a substance havii g@ cry stal 


line structural properties which dif- 
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from those of another substance 


the 


ler 
with 
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identical chemical composi- 
ion 

We have borrowed the term para 
mor phic m 1 em 


' 
ineraliogy and 


ploy to representations 
The 
iplete, but its limita 


The 
the 


‘ t 


analogy 


rious 


mat he 
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chemical 
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g the outcomes of 
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with 
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are other prop 
still undescribed, 
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The 
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re presented 
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representa 


idgment, would 
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the 


described above, 


signihcance 


parti ipated as 


it Oregon have 


s called a para 


»> be a alteration 


the example cited, : 


lergo change over a period 


ng calcite It 


1: alteration of 


is the 
aragonite 


which is paramorphi 


for the 


intellige e 


iple profile idgment of 


made 
100 


pe rsons on the basis ol a set of nine 


been selected Iwo of these 


judgments of “intelligence” of 
predictors or sources of information. 
The remaining two made judgments 
of ‘“‘sociability’’ of 150 persons on the 
basis of profiles containing scores on 
eight Edwards Personal 
Preference Schedule (EPPS) vari- 
ables In all the judges re 
turned after an intervening period of 


selected 
cases, 


several days and made a second set 
of judgments on the same profiles 
Sample profiles are shown in Fig. 1 
and Fig. 2 

Application of standard multiple 
regression procedures reveals that a 
best linear combination of the pre- 
948 and .829 
Judges 15 
But to what 
t be said that the linear 
the 


judgment process for these judges? 


dictor scores correlates 
the 
and 18, 


extent can 


with judgments of 


respec tively.* 
model adequately characterizes 
The reliability of judgment for these 
two is .876 and .836 respectively 
Correction for attenuation results in 


* Corrected for 


Multiple Rs 


a cross-validation sample of 


shrinkage 
computed from 
protocols were .937 and .837 for these Js re 
spectiveiy. 








PARA MORPHI( 








to each of the information 


s will be 


weipni 


Figs 


Judge 18, 


referred 


‘ 


to as the 


( Ompa>riso! S 


relative weights 


two judges of u 


Sa 


nd 4 


With re 


there is a high de 


Oo 


rel 


For 


wre 


t beu 


ite 
a 
the 
of 


itive a 
ludge 15 


*T dis re | 


most pre 


4, and j 
extent t 
issignit 

sources 


it 


weights 


7 
mode 


REPRESENTATION 








4. Comparison of relative and subje 
tive weights in the judgment of intelligence 
ludge 18 


The two examples from the socia- 
bility experiment can be used to 
illustrate the same phenomena. The 
relevant information is described in 
lable 1 and in Figs. 5 and 6. 


\ CONFIGURATIONAL MODEI 

REPRESENTATIVE RESULTS 
Data for one type of configura- 
tional model comes from a study by 
Martin (1957 On the basis of 
and rather complete inter- 
Martir was able to obtain 


let gthy 
views 

fairly clear statements from a set of 
five counselling psychologists These 
statements expressed the manner in 


which the psychologists believed 
they were utilizing the set of eight 
EPPS variables in the prediction of 
sociability Of the five judges, Psy 


chologist D has been selected for 


Fe & SOCIABILITY 


predictable from the linear model 
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The higher Aba. along with 


extremely high 
d the lower the 


the pair Def. and Suc. a 

Dom., Het., and Exh., the lower 
The pair Chg. and Aff. again have 

they are sig I 





scales the 
rating 


little effect u 
und then they tend 


less 


aqaryt low rating 
; In rating within the 
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~ average 
’ for the signi 


and Aba.. not be extreme 
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t one a 
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rating whether singly or 


uf 


From the foregoing 
it may be argued that t 

*s underlying Ds judgmer 
the f | 


to account ne 


s 


purposes His verbaliza 
respect to the judgme 


Interaction Certa 


interactive 


f< Tt imply an 
lationship betwee 
the judgment 


crite 


erauy 


t be expected I ge 
of this is the state 


d Aff. are also cor 
add or detract 


less both are quite 
cardy Since 


{ most 


Nonlin 
varia are 
their values 

tle 
thers least it . 
— i an expone 
} 
womting in the direc n 
po g t nore pre lictive 
for this rating tl . 
or sra g at . one 
tian af , 
. . resuit 


ilso expect 

. ' -< the dire 
ge range Che GIT the followi 
that Exh. + Dom. -+Het. ap } 

d Aba. the low extrer » , 


high extreme a 
re apt I am to make a higher rat 
s concept the other fo 


| 
ur scares act 


nditions 





le, if the above « 
d Suc. are not in either extrer 
naffected If both 


1 to add to ther 


Ww €xamy 


4 


are extremely high they tend t 
h Sociability 

ff. are also co 
w detract nothing t 

r less | are quite high 
If both should be extremely low a 
ther conditions for a high rating are 
ylity of the tes 


= 
would suspect the relia t 
In the case of a low rating 


1 


l 2 3 I wour 
expect a somewhat opposite patter: 

For example, here I would expect Aba 
be quite high with pair Suc. and Def. in the 
or ting wu the directi ot 
{ 6. Compariso 





range 
Similarly, I would expect at least two 

I scores (Don Exh ind Het to be 
in the middle or low range with none of them Judge 6 


jective weights in the judgment 
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xX, Dominance 
X, Change X Affiliation 
X, Succorance X Deference 


Each of the six predictors can then 
nonlinear trans- 
formation, the result of which is to 
the stated 


the judge to discount predic tor scores 


be subjected to a 


correct for tendency of 


near the mean of the distribution, 
and to emphasize them increasingly 
become 
The 
weighted 


as the. extreme, up to a 


limit resulting variables 


then 


are 
according to least 
squares proc edures 

As in the case of the linear model, 
compute relative 
weights and to compare these with 
the 
his comparison is shown in Fig. 7 
We shall discuss the data shortly 

What classes of problems can be 
ittacked 


the configurational model? 


it is possible to 


weights assigned subjectively 


through the technique of 
As in the 
ase of the linear model, it furnishes 

l the 


1 description ol relative 
to the judge 


of the vari- 
ous sources of information available 


im- 


™ rtance 


But greater latitude is possible C454n- 


f rational models are capable of 


h il dit 


terns believed by 


sential (if 


g the complexities and pat- 
to be an es- 
‘natural”) part of the 
Thus, one may 


many 
not 
idgment process 
graduate 
psychodiagnostics or in personality 


ask whether a course in 
assessment was effective in produc- 
who 
their 


ing students are ‘configura 


tional” in interpretation of 
case material 

A second 
of individual differences 
the 


most appropriately accounts for their 


class of problem is that 
Do persons 
model which 


differ in type of 


judgments? If so, in what respects? 
And 
ferences can be attributed to specifi 
To intel 


what proportion of these dif 


training? To personality? 
lectual characteristics? 


There is a third class of problem, 


one which is at least of equal signifi- 
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Fic. 7. Comparison of relative and subjec- 
f ) 

weights using a nonlinear 
Clinician D (From Martin, 1957 


tive model 


This 


judg- 


cance to the others mentioned 
stability of the 


an a “‘linear’”’ 


concerns the 
ment process. ( judge 
be taught to be more complex? Can 
any judge be taught to make more 
efficient and more accurate use of in- 
Will 
transfer to other judgment 


What are the 


characteristics which differentiate the 


formation? this generalize or 
situa 
tions? personality 
flexible judge from the unchangeable 
Some of these problems are 
and 
forthcoming 


oner 


currently under investigation 


results will appear in 
publications 
Finally, it 


apparent 


may already have be- 
that the 
nomothetic vs. tdiographic approaches, 
first proposed by Windel’ and (1904 
and discussed more thoroughly else- 
where (Allport, 1937; Sarbin, 1944) 
be approached in one of its 
through the 
judgment models. If the argument 
that of 
combination,” as suggested by Meehl 


come issue of 


may 


major aspects use ol 


is confined to “method of 
1954), representational models are 
providing some strik- 
ingly clear evidence. Martin (1957 
findings 


capable of 
some interesting 
in this respect, and it may be well 
for illustrative purposes to return to 


presents 
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Psyc hologist D, discussed above, What, additionally, 


may be said 
and ask what the data suggest of the 


configurational model de 
The first thing that might be said veloped for D? We may legitimately 


with respect to this psychologist is ask to what extent the substitution 


fter having defined the pre ol complex variables in the pla e ol 
to his liking, he is not as 
} 


simple ones effectively enhanced the 
he might be in attaching prediction of judgments, thereby 
} 


> 
welgi 


its them. By this testing the relative effica if two 
th if the dis repancies be models The R (corrected for shrink 
ind relative weights age), using the configurational model 

ins Signin in ! is .d5S5 Ch 


I he 


ippi itio 


1u lg me nts 


ot 91 Thus, subst 


urational model 


h inges the 


MMARY 


is paper has 


h the 


perhaps reckless 


it this point, particularly in that the f ition of 
error variance for relative and sub may be 


jective weights is not presented for morphic represé 
these data Che purpose of the paper ippears to otter 


is more to illustrate the application bilities for research 
of a methodology than to argue for ll as for applied endeavors 


reforms in clinical psychology from which attempt to describe the 
evidence based on a sample of Size 1 ol 


fi combination of informat 





PARA MORPHI( 


making ¢« 


yg in illuminate 
which 


prob 

rematl 
the indi 
research w hile 


e preserving method 


beco 


would otherwise 
In focus 


pik 


ol 


upon 
nit 


mes possible to 


REPRESENTATION 131 
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reviews ol 
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Delp, 1953b: 
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Shafter 
rejection of the 
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1949), to a 
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1953 All of the re 


impressed by 


critical 


lerson, 
were favor ibly 
1 the standardization 


riticisms 


were 
the WIS( 
evidence tor its 
Delp, 1953b; Met 
1949 it | 
elaborate pattern 
res McCandless, 
substantia 
terpretive value (Delp, 
1953: Shaffer 


men- 
ywever manual 
overt all 
indless, 
Shafter, rovides a 


to do 
wut providing 


c{ indiecss, 


loes not provide for ex- 


high above 155 or ex 
low (below 45 


ind the subtests appear to 


scores Delp 


young chil 


difficult for 


Delp 1953b 


very 
The mental age 
nissed by Anderson (1953), Delp 
and Shaffer (1949 
Negro children in 
group was met tioned as a 
McCandless (1953 
felt further the 
of certain verbal 


: and the 


the stand 


ikness by 
Delp (1953b that 
items in 
siderable subjectivity. An 
] (1953 


s rather critical review 
fact that raw scores of 


ned the 
above 
Ander 
to find several 
Wechsler’s 


standard 


ire ywiven scaled scores 
zero for the younger children 
fact, able 
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statistical treat me 
data 
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Mentioned also as strong points were 
the facts that all of the children are 
administered comparable batteries 
McCandless, 1953); the time of ad- 
ministration appears to be shorter 
(Delp, 1953b) and more predic table 
(McCandless, 1953) than comparable 
to administer, in- 
teresting to both a 
Verbal and Performance IQ, provides 
IQ's directly comparable for various 


tests; it iS @€asy 


children, gives 


ages, appears to have potential clini- 


cal use, and has an easily used man- 
ual (Delp, 1953b 

1 framework for evaluation, A 
word should be said concerning the 
framework within which this evalua- 
tion of the WIS¢ 


number of 


is conducted. In 
articles re- 
the 


also 


addition to a 
porting research on or with 


WIS the last 10 


show I advan es in 


years have 
the methodology 
of psychological measurement and 
construction See especially 
1951; Raiffa, & 
1954; American Psychological 
1954; Cronbach & 
rhe psychological test 


theory 
Coombs, Coombs, 
Thrall, 
Association, 
Meehl, 1955 
has come to be seen as only one ele- 
ment in the total process of theory 
Ihe full value of the 
test as a measure ol a psy¢ hological 


construction 


variable depends upon how well the 
entire system in which it is used 
stands up to both logical and exper 
mental test 

This view of the over-all ‘‘validit» 
of a test demands that (a) the area of 
world to be covered, (f 
network 
the 
which the test is demonstrated to be 


made 


the objec t 


the nomotheti containing 


the variable, and (« steps by 
a measure of the variable, be 
public, that all 


subjected to empirical test. 


and assertions be 
1 review of the lit- 
erature the WISC since 
its publication in 1949. Its purposes 
are twofold: (a) to evaluate the 
WISC as a measure of various psy- 


This article is ; 


concerning 





4 WILLIAM M. LITTELI 

telligence Unfort if tely, be. mynd i 

together for the user of the WISC ir few general remarks (Wechsler: 1949 

formation provided by the past de 1950; Wechsler & Weider, 195 
, : 


ide of research 


ibles, and to bring 


hologi il vari 


theoreti 


rue WISC as A MEASURE Of! 
INTELLIGENCI 


= iles \s 


1953b Shafter 


l 


iSse 


the WIS¢ 
he defit 


Wechsle 





THE WECHSLER 
can be ascertained, for no statements 
are made to limit the possible range 
of tactors 

On a less formal level, however, 
there seem to be several factors often 
ncluded in 
of intelligence, but not adequately 
ited in the test While these 
would be of little conse 
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represe 
“omissions 
juence if the were 
strated to have 
might provide fruitful 
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parti ular situa 
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ight have been This type of 
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tion of a general factor which enters 
into the purposeful solution of all 
whether they occur in a test 
While Wechsler 


speaks convincingly of other, non- 


problems 
or in the child's life 
intellective factors which enter sig- 
nificantly into a child's actual behav- 
ior in problem situations, there ap- 
pears to be little evidence that these 
sampled in any system- 
manner rhis the 
of the WISC to depend very heavily 
on whatever demonstrated criterion 
nted and validity 
WISC might have 


lactors are 


ati forces user 


orie construct the 


Predictive Validity 


If the the term predictive 


validity 


use ol 
is restricted to correlations 


the WIst 


licted 


between and some nontest 


measure of pre¢ behavior ob 
time subsequent to 
the the WISC, 
there are no relevant studies in the 
This is very sur- 


tained at some 


administration of 


literature revic wed. 
[ ing, as it is difficult to conceive 
of any situation in which the WISC 
might be used that would not involve 
behavior. As it 


mris 


the 
stands, this lack of explicit evidence 
of the value of the WISC in the pre- 
diction of subsequent behavior must 


prediction ol 


be viewed as a major weakness of the 


n neral, reports ol the concur- 
rent validity of the WISC have been 
restricted to correlations between the 
WIS( test measures of 
achievement or intelligence Most 
of the studies relating the WISC to 
tests have been 
the com- 


and other 


other intelligence 


oriented toward assessing 
parability of the various IQ scores. 

Stanford-Binet. Studies reporting 
the comparability of WISC 
with S-B scores on different popula- 
tions of children began to appear soon 


after the publication of the WISC. 


scores 
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\ summary of these correlations ap- (1951) followed summarizing the re 
Table 1 sults of five unpublished master's 

Frandsen and Higginson (1951 theses They concluded “that the 
reported a study on 54 fourth-grade WISC IQ should not be interprete: 
hildren and concluded that “IQ as equivalent to a Binet IQ at ag 
norms from the S-B and WIS¢ are levels below 10 years of ge since the 


omparable at least within the range WISC score is n ntly lower 


pears in 


‘ gRS 


of one to two sigmas above ind below than that of the Binet”’ p 
- : 


1e mean p. 283 Chis is the most Krugman, Justman, Wrightstone 
favorable and unqualified statement and Krugman (1951) found sig: 

of the comparability of the WISC cant differences between the WIS( 
ind S-B appearing in the literature Full Scale and Performance Scalk 


An article by Pastovic ; 1 Guthrie [Os ul the S-B IO it all age levels 


} 
‘ 


t 


TABLE 1 


hneider (1951 


®* V =Verbal Scale; P = Per 
» Studies summarized by Pasto 
* Study conducted using Form 
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5-15 which 
favor of the S-B 
the S-B and 
tended to be 


were consistently in 
Differences between 
WISC Verbal Scale 
significant only at 
younger age levels. They concluded 
further that 


ency for 


‘there is a definite tend- 
yreater differences to 
be associated with the higher Stan- 
ford-Binet IQ's, 
between S-B ar 
Full Seale 1Os ; 


ind that differences 
id WISC Verbal and 
tend to be associated 
with chronological age, in that such 
ire larger it 
levels” (p. 482 

It should be : 


if IO 


differences younger age 


oted that a child can- 


not obtain ibove 154 on the 


WISC without extrapolation beyond 


while the S-B would allow 
This fact may 
that the 


associated 


the rms 

ich higher scores 
explain | part the finding 
differences were 
higher S-B 1Os 

Weider Noller, and 
(1951) also found that while 
and WISC IOs are sig 
related the Binet 10's tend to be 
WISC 10's for the 


hildres p. 332 \ regression 


greater 
with the 
Schraumm 
the S-B 
ificantly cor 
h gher 
une 
equation was suggested relating S-B 
to WISC Full Scale 

WISC ¢ 


10s in which 
ls 0.85 Binet plus 11. Ac- 
cording to formula, when S-B 
IOs are the WIS IQs 
would be higher than the S-B IQs 

hen and Collier (1952 Mus 
sen. Dx nberg (1952), and 


Derg” 
Stroud 1957 


this 


below 73. 


ind Rose 
Blommers and Lauber 
ilso reported 
the S-B and WIS¢ 
WIS 


ormal and upper ranges 


correlations between 
Further evidence 
th at the te nds to score chil 
dren 
lower than the S-B is presented by 
th, Muhr and Weisgerber (1952 


in their 100 


Kure 


study of five- and six- 


and by Levinson 


his study of 117 Jewish pre- 


vear-old children, 
1959 


school children 


riggs and Cartee 
1953) tested 46 rather select children 
in the kindergarten of an independent 
S-B mean IQ of 124.11), and 


school 
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found WISC IQs to be consistently 
lower (Full Scale mean of 107.58 
They concluded further that ‘there 
is a marked tendency for larger dif- 
ferences between Stanford-Binet and 
WISC 1Q’s to be related to higher 
Stanford-Binet IQ's” (p. 29). 
Arnold Wagner 


amined 50 children drawn at random 


and (1955) ex 


from elementary schools and 


cluded that 
concerned, the relationship between 


‘so far as this sample is 


IQ's obtained for eight- and nine- 
year-olds with the WISC (Full Scale) 
and Form L Binet is not significantly 
different 
tween IQ's obtained on Forms L and 
M of the Binet” p. 93) The Verbal 
Scale related significantly better with 
the Binet than did the Performance 
Scale 

Preschool S-B IQs were compared 
with the school-age WISC [Qs of 113 
random 


from the relationship be- 
} 


children selected at from a 
clini population born at a women’s 
hospital (Schachter & Apgar, 1958). 
Of the 404 chtidren requested by mail 
to return for testing, 119 returned for 
both for 
other reasons. The resulting correla- 
tion of .67 (see Table 1) between the 
S-B and WISC Full Scale [Qs was 


reported to compare favorably with 


tests; six were eliminated 


previously reported correlations be- 
tween preschool and school-age S-B 
IOs 

The comparability of IQ scores of 
the WISC and S-B when applied to 
mentally defective children has been 
Nale 
found the rather high correla- 
tion of .909 between the WISC Full 
Scale and the S-B, Form L, for 104 
defective children, while Stacey and 
1951) and Sloan and Schneider 
report correlations of .68 and 


investigated by several authors 


(1951 


Levin 
1951 
493 respectively. In 
WIS( 
somewhat higher than the 
these defective children. 


general, the 
Full Scale was found to score 
S-B for 
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Sandercock and Butler (1952) com- ages and IQ ranges are very con 
pared the WISC and S-B, Form M sistent in showing that at least withir 
LOs of 90 mental i ctive chil a white American school popula 
dren and concluded that “correla the WISC and Stantord-Binet scores 
tol ined between the Stanford are related to a significant degree 
Binet ind the three WISC I1Qs__ Correlations between the WISC | 

Scale and the S-B are 


he 


' 
tor 


igh degree of relation ship 
betwee! > Binet and WISC Ver reported within t 
bal’’ (| » The WISC s 
Several . nciu 1 ind lowe i S.B sco 


overlap 
igh 15 has le 
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Scale correlations are reported in the 
70's and .80's 
2. The W-B Verbal Scale scores 
tend to be significantly lower than 
the WISC Verbal Scale scores for the 
same child. It may well be that the 
WISC items are more appropriate at 
this age level 
Other individual intelligence tests 
In the following studies the WIS( 
has often been used as the criterion 
st which the other test is vali 
Ihe results of these studies 
reported 
Three studies & Collier, 
1952 Pastovic & Guthrie, 1951; 
Sloan & Schneider, 1951) are reported 
in which the WISC has been corre 
lated with the Arthur (see Table 3 
The Arth ir, as might be expected, 
ippears to correlate better with the 
WISC Performance Scale than with 
the Verbal Scale 
Because of ‘ length of time 
needed to administer the WISC, 
Martin and Wiechers (1954) investi- 
gated the possibility that the ¢ olored 
Progressive Matrices could be used as 
i measure of intelligence with greater 
brevity than the WIS¢ inda similar 
degree of validity. One hundred nine 
year-old children from four Indiana 
schools were given the Matrices and 
the WISC is counterbalanced order 
1uthors concluded that “in view 
correlations (see Table 
ise and speed of admin- 
istration it would seem that the Col- 
ored Progressive Matrices will find 
ore extensive use in the clinical 


Idren” (p. 144 


the POSITIVE results ob- 

Marti ind Wie« hers, 

ice and Carleton (1955) investi- 
ated the degree to which the WISC 
1 S-B scores of Ss for a restricted 


range of intelligence (possible menta- 
defectives) compared with performl 


ance on the Colored Progressive 
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Matrices They found much lower 
correl: 

Motivated also by 
sarratt (1956) investigated the rela 
sh p between the WISC and the 
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the time factor 
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nt EGY 
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type ol que s 
to determine 
tests 
t for 
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ministered 


study 
available 
ichievemer 
the Territory 
WIS¢ is ad 
le of 51 fifth grade 
1958 In spite of the lar 
rave handicap, significant correla 
with the Leiter 
Scale and 


WwW 
children 

> ype tT 
ions wer»re reported 


nternational Performance 
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the Columbia Mental Maturity Scale 

Group intelligence tests 
tions between the WIS( 
ence Research 
Mental Abilities 
by Ste 195 
lable 4 

Altus (1952) reported correlations 
between the WISC and the ¢ 
lest of Mental Maturity (¢ 
She selected a of 
High School children so 


t the entire 


Correla- 
and the Sci 
Associates Primary 
lest 


and are 


are re ported 
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iple 3 hown in 
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nsideral validity 
p. 231 
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all report rather hig] 
the WIS 
igain the small number 
lud than the 
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vidu abilities 


as 


the studies reviewed 
. correlations be 
tween and group intelli- 
gence tests, 


ol 
very 


studies preciudes more 


tentative ac ept ince 


conclusions 


{ “tT 
icAhtlet 


et al 
reported a study with a group 


vement tests Mussen 
1952 
of Ohio State University elementary 
sé hool WISC 


children correlating 
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rious measures ol pe ling tests of the lowa Tests of 
hese correlations Basic Skills battery’’ p 18 The 


Ss] The fact that tests were idministered to 725 pupils 


ge was limited by in grades three to six drawn from a 21 
population” 1 yunty area i ywwa. All of the chil 
the obtained lren had been. referred for psycho- 

il interviews and testing and 
were in, or were thought to be 
some kind of school difficulty” 


tor fou | nm | Ihe mean IQs were within 


the WIS scores 


\chu 


609 
to 

elatior 
the WIS 
tt directly related to 
nent M Issel c al 1952 


relations between teach- 


‘ pposition and 


tell gence on the Hag- 


ichman Rating Scale 

bing ind the WISC of .64, 

suld be used to . n or the ‘% sual, Per- 
ce on Reading ance, and Full Scales respec- 


Arithmetic, al 
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than for bi (1955 who reported an 


analysis of the WISC for 


a 
e ol 366 sub ects teste 


dat Syra 
ite School who ¢ in be class 


lefect 


ive borderline 


p. 149 They foun 
| | 
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ved children with 
| ach child was ad- 
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WISC Performance cioeconomic status 


" b) with panto higher scores 


und Group ({ 3. The WISC seems 
They tively insensitive 
and (b) did among mentally retarded 
from each 4. The WISC Perforn 
administer. wit! 
ions to either 


in be us | 


ind St ce’, 
21 difterent short fort 
the WISC rece 
who had been 
e State Sc ho 

whom there 

i volven 

They corre 
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ng correlations 
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be a niiica iriabl ( I il -d from .55 to .61 
IQ scores of your hildres cond felt that these low correlat 
opposed nithn - hildres be attributed either to the ‘wide sub 


such that th Idren i test scatter found in WISC records of 
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emotionally disturbed children, or 
the lower subtest intercorrela 
tions found in the WISC than on the 
Wechsler-Bellevue” (p. 277) 
Armstrong (1955) divided the Vo- 
cabulary subtest of the WISC into 
two short forms consisting of odd and 
words he over-all split-half 
for all ages five years no 
nths to 14 years 11 
She concluded that 
reliability involved in 
instead of the total 


months was 

the loss of 
using either 
ilternate word list 
Vor ibulary 


ympared to the time saved”’ 


list is minimal, especially 


of Menta 


the use of the 
both 
nd to suggested ways 
MA the WIS¢ 
1950) felt that while 

{ the WISC w; a 
Wechsler id 

iby out with the wash” 


hen h liscarded the concept ol the 


h is led 


ir TY 
iTo 


M ilong with its use as a “practi il 


nethod of defining levels of test per 
gg The author then pro 
nethod by which a mental 
| »btained 

imself, while still 
measure of 
dmitted that 
1 use in compar 
nage w ith chil- 
n performance 
age, he felt, 
neasure ol 
then out 
methods by 
which scores « po! ng to ‘test 

e’’ can be cal ited 
Kolstoe (1954) compared the per 
29 third- and fourth- 
grade children (S-B IQ 116 or above 
with 29 eighth- and ninth-grade chil 


S-B IO 84 or below) on 11 of 


ik 


formance ot 


dren 
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Differ 
level of 


the 12 subtests of the WIS( 
the .05 
significance were found on only three 
They concluded that 
a consider 
the 


ences significant at 


of the subtests 
“support to 


the 


their results 
able 


mental age concept” (p 


gener ility of 
167 


extent 


4S A DIAGNOSTIC 
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In keeping 
clinical I 
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ction are finding 
less general diagnosti 
The WISC is, of 
standard sample of 


and 


with the growth of 
tests previously 


ircums ribe | area of 


psy< ology, 
used 


j 


preal use as more or 


instruments 


course, i relatively 
i child’s behavior 
as suc h, can be used iS an\ other 
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; 1] 
ior instance, will nave 
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lar diagnostic implica- 
occurs on the WISC, 
ng a clinical 
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mpt to pre 
ypes of behav- 
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htest Deviations 


might expect, the almost 
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: nt’’ deviation 


Ali ena 1951 
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Wechsler 
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for evaluating dis- 
based on the exper ted degree 
variation within the 
The author reported that the 
eviation norms have been calculated 
for the WISC and are available on re- 
him 


indi- 


quest trot 


Differences betu Verbal and Per- 
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ind, while the 1Qs will Graham (1952) wished to check 
ossly similar, the clinical the assertion by others that the W-B 
cannot be carried over and WISC profiles of unsuccessful 
o the WIS( ders and psy hopathi adolescents 
noted that Rabin and are similar He went over the records 
their review of the of 96 unsuccessful readers (25°, or 


1950 conclude that more below the mean of the Wide 


‘ 


Ou gave birth toa Cange Achievement Test who had 
240 he num ich either a Verbal or Perform 


ore ot ¥O or ibove 
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Aside, perhaps, from correlations retarded on the assumption that 
’ 


between the WISC and Stanford they will respond to various learning 


Binet for normal white school chil situations in characteristic ways. 

dren, further investigation of any of How well does the WISC predict this 

the problems discussed could add sig response in a well-controlled, experi- 
| to our fund of knowledge, mental situation 

ind theoretical, cor % Much more systematic atten- 

WISC and its use [hree tion should be given to investigations 

urticular. however, stand of the many prac tical problems in- 

volved in the use of the WISC asa 

1. The WISC does not have ar measuring device There appears to 

idequate rationale Much more be strong reason to suspect that 

nd effort need to be de scores are affected systemati- 

itting the WISC on a firm y i y variables other than 

il foundatior \t present i! ig : i ittle information 

uwssessment of the test's con " *xact re of these vari- 

ng process of ibles and th lati hips involved 

severel' is available y in need of 

ex systematic investigation is the effect 

on WISC scores of (a) variables in 


the relationship between examiner 

and exa * circumstances 

of the examination, and (¢ repeated 
WIS¢ 

the WISC ap- 

1 relatively well-stand- 

urdized test with many virtues. It 

correlates consistently well with other 

easures of intelligence, appears to 

acce pted and used, and, in 

t further re- 
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COMMENTS ON “INTRACLASS CORRELATION VS. FACTOR 
ANALYTIC TECHNIQUES FOR DETERMINING GROUPS 
OF PROFILES” 


HAROLD P. BECHIOLDIT 


The multiple 


nply a comy que 
| one, 
simultaneously two, or 
vosite variables or ‘‘factors”’ 
f observations Appro 
They are pri ipp ati of the multiple 

h comparing the roup procedures will lead to any 
nd ‘‘direct corre e¢ possible orthogonal or oblique 


two ipproaches ixes or ‘lactors i he necessary sets 
problen il } ) fining the desired 


obtaining if a 


ile centroid”’ or 

methods with or 

I’ transforma 

apply cluster 

ethods base« ) in inspection of 

An investigator may use 

“theoretical” or even 

within limits) an arbitrary formula- 

tion for the weights or supplemental 

information such as clinical ratings of 

cases as ‘“‘h perte sive,”’ ‘neurotic _ 

or ‘‘psychotic,”’ the procedure used in 
the paper under discussior 

The ‘‘oblimax rotational solution” 

is simply one of the several available 


inalytical procedures, each of which 


TECHNIQUES defines the “‘factors’’ by an objective 
by Haggard transformation of certain types of 

the in data called “‘factor loadings.” As de- 

orthogor n fined by Thurston 1947), factor 

loadu gs are the ‘orthogonal projec 
ind the tions’’ of the variates, considered as 

three, or vectors, upon a set of special axes 

methods of added to the system and named 

early miscon “normals” or ‘‘reference axes.’" The 

I group ind oblimax procedure is a method for 
ntroid techniqu inct meth “rotating’’ such a set of reference 
ods has bee larifi in papers by ixes, either orthogonal or oblique, to 
Guttman (1944, 1952) and Harman positions defined by a mathematically 
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stated criterion 


The 


the oblimax procedure’ is 


that 


restricted 


common misconception 


to rotating orthogonal reference axes 


t in part for the inappro 


comparison 


may accouil 


. ' 


by Haggard et a 
ax data (Set A 


the 


priate 
1959) of 
the 
group method 
Table 2, 


discussion of 


the oblin 
trom nultiple 


Set B 


with data 
their 
their 


two sets ol data 


shown in 
page 51 However, 
these 
in terms of factor loadings and pro 
their untenable 


yections as well as 


distinction betweer “oblique space 
space” sugwest i 


the 


and “orthogonal 


lack of understanding of basi 


factor anal 
Thurstone (1947 
Harm nh 1941 
The computations tor the 
data Set ( data 
checked by the writer and have been 


com epts ol 


veloped by 
Holzinger and 
Set B 
and have been 
found to be accurate to with: 
Both of these sets of data 1 
l projections of i 


defined by 


orthogonal 
mary axes” the 


troids of three “‘clusters”’ or groups of 


profiles; are named 


the 
and 


sy str 


such projection 
" by Holzinger 
ilthough Hag 
lues as 
the 
refer to 


factor ucture 
Harman (1941 
gard et al. refer to the Set B va 


pattern’ and use 


the ‘factor 
term “factor structure” to 
the intercorrelations among the fa 


ati 
2 The Set B and Set ( 


two sore wh if 


tors (p 5 
data 
different 


lerived from 
ot “clusters” of 


ire 
lefinitions 
profile vectors 

The Set A values 
centroid solutio 
tion This desigt 
data is ambiguous 


from 


. “ot 
exper ‘ 


ire entitled the 
: oblimax rota 
ition of the Set A 
Che Set A val 
oblimax program 


gonal 


orthog 


wectio!r ““nort 


t ng referred to by Holzinger 


a be 


and Harman as the “factor pattern 


However, the values could also repre 


sent two other sets of projections 


Because ol what { tly are com 
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1: errors 


represe! 
the Set 
parabl 


lili 
when the 
the 


loadings,” 


tions on 
sion coetniciet 
covariances betwee 


the (profile) vari 


t 1 Teg_ressio! 


generally con 
However, the 
ind covar 

nine 

are related 
Holzinger & Harn 
Cor the 


the 


trary to 
Statements in 


cussion, the values 
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1 tactor 
tions betwee 
mary axes o1 
tween orthos 


the 


rections <¢ 


tere! 
+} 


se 





1SS CORRELATION VS. FACTOR ANALYTICAL TECHNIQUES 159 


TABLE 1 


THREE ALTERNATIVE METHODS FOR REPRESENTING A GIVEN FACTOR ANALYSIS SOLUTION 
OBTaInepd WITHOUT ROTATION 


Set B Set E Set | 


il Projections Oblique Project Orthogonal! Projections i? 


ister Primary on Cluster Prima on Normals or imun- 
“e 


Axes Axes Reference Axes 
ctor Structure) Factor Patter (Factor Loadings “stimates 


i] Il i] l I Il Ill 


49 y 801 
18 ; ‘ y 840 
‘ 078 


09 7 008 
O8 87 990 
11 ) 644 
10 801 


82 21 745 
99 15 2? 007 
96 ; : 10 11 9R3 
96 , y d 01 19 .973 
90 7 27 04 22 58 850 


Note Data mf ifs 12 MMPI ope les prenented by Haggard et al. (1959) in Table 1, p. 49. The correla 


trons het weer " ster primary axes, to two decimals, are given in Part II, Set B, of Table 2, p. S1, of 


Haggard et al 
®* The deci ly t been omitted Cols. I to IIT inclusive in Sets B, EF and F The decimal is located 


two places to th ft 74 


by some investigator as showing the one of the cluster vectors. (The sets 
“factor loadings’ of 12 MMPI pro- of primary axes and reference axes 
files on three axes defined by the are each collinear with the “inverse 
clinical groupings of “hypertensive,"’ vectors’’ of the other set.) If another 
‘neurotic,”’ and “‘psychotic."” These definition of the “factors’’ were used, 
data were computed from the 12 as in an oblimax solution, three (or 
MMPI profiles as published by Hag- four) additional “factor matrices” 
gard et al. The communalities were might be computed. Comparisons 
provided by | \. Haggard. No between the results for different 
“‘rotations’’ were made in obtaining definitions of the factors could be 
these results; a single grouping of made in terms of any of the corre- 
the profiles was made as specified by sponding (comparable) factor ma- 
Haggard et al. (1959 trices 

The Set B data are the orthogonal The “‘communalities”’ or ‘‘common 
projections on the three centroid factor variances’’ of the 12 MMPI 
cluster vectors, a set of “primary profiles are shown in the #*? column of 
axes,’’ while the Set E values are the Table 1. Since three of these values 
oblique or Cartesian projections on exceed unity, the upper limit for 
these same cluster vectors. The Set I “‘admissable’’ values of the com- 


data are the orthogonal projections munalities, the analysis is a ‘“Hey- 


on the reference axes or normals, wood" case and not a “proper” factor 
each of which is orthogonal to all but analysis (Thurstone, 1947). The 
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A REVIEW OF HEARING IN AMPHIBIANS AND REPTILES' 
THOMAS E. McGILL* 
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